[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:24:44.350034  3873 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.200.126:42665
I20260709 12:24:44.352217  3873 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:24:44.353314  3873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:44.368084  3880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:44.370059  3882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:44.368129  3879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:45.563550  3881 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 12:24:45.563583  3873 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 12:24:45.568343  3873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:45.568676  3873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:45.568914  3873 hybrid_clock.cc:648] HybridClock initialized: now 1783599885568880 us; error 0 us; skew 500 ppm
I20260709 12:24:45.569765  3873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:45.575245  3873 webserver.cc:533] Webserver started at http://127.3.200.126:41637/ using document root <none> and password file <none>
I20260709 12:24:45.576231  3873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:45.576458  3873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:45.577004  3873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:45.582852  3873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/master-0-root/instance:
uuid: "0560adfdcd774694bc6ccb95038c1941"
format_stamp: "Formatted at 2026-07-09 12:24:45 on dist-test-slave-px1m"
I20260709 12:24:45.590998  3873 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:24:45.596532  3888 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:45.597795  3873 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:24:45.598179  3873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/master-0-root
uuid: "0560adfdcd774694bc6ccb95038c1941"
format_stamp: "Formatted at 2026-07-09 12:24:45 on dist-test-slave-px1m"
I20260709 12:24:45.598543  3873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:45.657547  3873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:45.659097  3873 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:24:45.659566  3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:45.731786  3873 rpc_server.cc:307] RPC server started. Bound to: 127.3.200.126:42665
I20260709 12:24:45.731861  3939 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.200.126:42665 every 8 connection(s)
I20260709 12:24:45.739593  3940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:45.762076  3940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941: Bootstrap starting.
I20260709 12:24:45.767949  3940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.769857  3940 log.cc:826] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941: Log is configured to *not* fsync() on all Append() calls
I20260709 12:24:45.774608  3940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941: No bootstrap required, opened a new log
I20260709 12:24:45.796533  3940 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0560adfdcd774694bc6ccb95038c1941" member_type: VOTER }
I20260709 12:24:45.797250  3940 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.797518  3940 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0560adfdcd774694bc6ccb95038c1941, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.798583  3940 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0560adfdcd774694bc6ccb95038c1941" member_type: VOTER }
I20260709 12:24:45.799110  3940 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:24:45.799432  3940 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:24:45.799793  3940 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.804119  3940 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0560adfdcd774694bc6ccb95038c1941" member_type: VOTER }
I20260709 12:24:45.804927  3940 leader_election.cc:304] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0560adfdcd774694bc6ccb95038c1941; no voters: 
I20260709 12:24:45.806661  3940 leader_election.cc:290] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:24:45.807024  3943 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:45.809377  3943 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [term 1 LEADER]: Becoming Leader. State: Replica: 0560adfdcd774694bc6ccb95038c1941, State: Running, Role: LEADER
I20260709 12:24:45.810374  3943 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0560adfdcd774694bc6ccb95038c1941" member_type: VOTER }
I20260709 12:24:45.811494  3940 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:24:45.821509  3944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0560adfdcd774694bc6ccb95038c1941. Latest consensus state: current_term: 1 leader_uuid: "0560adfdcd774694bc6ccb95038c1941" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0560adfdcd774694bc6ccb95038c1941" member_type: VOTER } }
I20260709 12:24:45.822100  3944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:45.822324  3945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0560adfdcd774694bc6ccb95038c1941" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0560adfdcd774694bc6ccb95038c1941" member_type: VOTER } }
I20260709 12:24:45.823139  3945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:45.825655  3952 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:24:45.839008  3952 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:24:45.841408  3873 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:24:45.856593  3952 catalog_manager.cc:1383] Generated new cluster ID: bb0550f098cf4830a65baf6ee4585b24
I20260709 12:24:45.856952  3952 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:24:45.891353  3952 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:24:45.893515  3952 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:24:45.909883  3952 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941: Generated new TSK 0
I20260709 12:24:45.910926  3952 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:24:45.973078  3873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:45.981638  3962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:45.983444  3963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:45.987211  3965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:45.987948  3873 server_base.cc:1061] running on GCE node
I20260709 12:24:45.988927  3873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:45.989190  3873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:45.989414  3873 hybrid_clock.cc:648] HybridClock initialized: now 1783599885989394 us; error 0 us; skew 500 ppm
I20260709 12:24:45.990231  3873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:45.994522  3873 webserver.cc:533] Webserver started at http://127.3.200.65:35445/ using document root <none> and password file <none>
I20260709 12:24:45.995263  3873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:45.995529  3873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:45.995869  3873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:45.997432  3873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/ts-0-root/instance:
uuid: "1b10efe7f4e34d9d84606f74160c6624"
format_stamp: "Formatted at 2026-07-09 12:24:45 on dist-test-slave-px1m"
I20260709 12:24:46.004356  3873 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:24:46.009621  3970 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.010514  3873 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 12:24:46.010890  3873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/ts-0-root
uuid: "1b10efe7f4e34d9d84606f74160c6624"
format_stamp: "Formatted at 2026-07-09 12:24:45 on dist-test-slave-px1m"
I20260709 12:24:46.011270  3873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:46.036274  3873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:46.038157  3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:46.041083  3873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:46.046471  3873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:46.046765  3873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.047071  3873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:46.047289  3873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.136997  3873 rpc_server.cc:307] RPC server started. Bound to: 127.3.200.65:36853
I20260709 12:24:46.137090  4033 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.200.65:36853 every 8 connection(s)
I20260709 12:24:46.144799  3873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:46.156483  4038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:46.157487  4039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:46.165092  3873 server_base.cc:1061] running on GCE node
W20260709 12:24:46.167032  4041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:46.168145  3873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:46.168433  3873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:46.168682  3873 hybrid_clock.cc:648] HybridClock initialized: now 1783599886168664 us; error 0 us; skew 500 ppm
I20260709 12:24:46.169454  3873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:46.174106  4034 heartbeater.cc:344] Connected to a master server at 127.3.200.126:42665
I20260709 12:24:46.174206  3873 webserver.cc:533] Webserver started at http://127.3.200.66:43061/ using document root <none> and password file <none>
I20260709 12:24:46.174579  4034 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:46.174929  3873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:46.175202  3873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:46.175539  3873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:46.175632  4034 heartbeater.cc:507] Master 127.3.200.126:42665 requested a full tablet report, sending...
I20260709 12:24:46.177038  3873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/ts-1-root/instance:
uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
format_stamp: "Formatted at 2026-07-09 12:24:46 on dist-test-slave-px1m"
I20260709 12:24:46.178601  3905 ts_manager.cc:194] Registered new tserver with Master: 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853)
I20260709 12:24:46.180766  3905 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57688
I20260709 12:24:46.184157  3873 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.005s
I20260709 12:24:46.189249  4046 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.190137  3873 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:24:46.190515  3873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/ts-1-root
uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
format_stamp: "Formatted at 2026-07-09 12:24:46 on dist-test-slave-px1m"
I20260709 12:24:46.190891  3873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:46.218799  3873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:46.220206  3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:46.222626  3873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:46.225924  3873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:46.226198  3873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.226521  3873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:46.226742  3873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.324802  3873 rpc_server.cc:307] RPC server started. Bound to: 127.3.200.66:45915
I20260709 12:24:46.324870  4108 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.200.66:45915 every 8 connection(s)
I20260709 12:24:46.331288  3873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:46.340971  4112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:46.345819  4113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:46.348453  3873 server_base.cc:1061] running on GCE node
I20260709 12:24:46.349841  4109 heartbeater.cc:344] Connected to a master server at 127.3.200.126:42665
I20260709 12:24:46.350229  4109 heartbeater.cc:461] Registering TS with master...
W20260709 12:24:46.350943  4115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:46.350992  4109 heartbeater.cc:507] Master 127.3.200.126:42665 requested a full tablet report, sending...
I20260709 12:24:46.352114  3873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:46.352397  3873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:46.352650  3873 hybrid_clock.cc:648] HybridClock initialized: now 1783599886352630 us; error 0 us; skew 500 ppm
I20260709 12:24:46.353273  3905 ts_manager.cc:194] Registered new tserver with Master: a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915)
I20260709 12:24:46.353410  3873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:46.355023  3905 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57692
I20260709 12:24:46.356424  3873 webserver.cc:533] Webserver started at http://127.3.200.67:37881/ using document root <none> and password file <none>
I20260709 12:24:46.357090  3873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:46.357345  3873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:46.357651  3873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:46.359009  3873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/ts-2-root/instance:
uuid: "04d87c7382a4441da74afbdaee7db6f8"
format_stamp: "Formatted at 2026-07-09 12:24:46 on dist-test-slave-px1m"
I20260709 12:24:46.364758  3873 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:24:46.369010  4120 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.369927  3873 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:24:46.370258  3873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/ts-2-root
uuid: "04d87c7382a4441da74afbdaee7db6f8"
format_stamp: "Formatted at 2026-07-09 12:24:46 on dist-test-slave-px1m"
I20260709 12:24:46.370618  3873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599884178482-3873-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:46.399092  3873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:46.400745  3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:46.403281  3873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:46.406971  3873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:46.407253  3873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.407581  3873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:46.407791  3873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:46.492446  3873 rpc_server.cc:307] RPC server started. Bound to: 127.3.200.67:33475
I20260709 12:24:46.492514  4182 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.200.67:33475 every 8 connection(s)
I20260709 12:24:46.511606  4183 heartbeater.cc:344] Connected to a master server at 127.3.200.126:42665
I20260709 12:24:46.512020  4183 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:46.512966  4183 heartbeater.cc:507] Master 127.3.200.126:42665 requested a full tablet report, sending...
I20260709 12:24:46.515234  3905 ts_manager.cc:194] Registered new tserver with Master: 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:46.515842  3873 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015741299s
I20260709 12:24:46.516716  3905 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57696
I20260709 12:24:46.568945  3905 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57702:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:24:46.573123  3905 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:24:46.674371  4148 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8fedb0755e4ee086e2a983e5b8e4b3 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:46.674592  4146 tablet_service.cc:1511] Processing CreateTablet for tablet 7183afdd01454a648af43ec00011d369 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:46.675925  4143 tablet_service.cc:1511] Processing CreateTablet for tablet 3d1b4e857aff48e296a9a69c27a84ac2 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:46.676870  4147 tablet_service.cc:1511] Processing CreateTablet for tablet 80c25035ddbd458b810ee7ad5b3e4855 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:46.678298  4148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8fedb0755e4ee086e2a983e5b8e4b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.678843  4144 tablet_service.cc:1511] Processing CreateTablet for tablet d72d31ebf33b4960ac55664142d46f32 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:46.677829  4145 tablet_service.cc:1511] Processing CreateTablet for tablet 2c1b46cfb77a4d70863c1df111a27523 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:46.682345  4144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72d31ebf33b4960ac55664142d46f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.682703  4142 tablet_service.cc:1511] Processing CreateTablet for tablet db3bdead2b554329a75fc42e9c661425 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:46.684063  4142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db3bdead2b554329a75fc42e9c661425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.686050  4145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c1b46cfb77a4d70863c1df111a27523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.688163  4147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80c25035ddbd458b810ee7ad5b3e4855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.690954  4143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d1b4e857aff48e296a9a69c27a84ac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.699047  4146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7183afdd01454a648af43ec00011d369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.697500  4141 tablet_service.cc:1511] Processing CreateTablet for tablet 9db9913c3c0e4ff4ae3afb2a1446a948 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:46.703713  4141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db9913c3c0e4ff4ae3afb2a1446a948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.700430  4140 tablet_service.cc:1511] Processing CreateTablet for tablet 1502de7867d7495bb2a73420c7190153 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:46.731456  3997 tablet_service.cc:1511] Processing CreateTablet for tablet 80c25035ddbd458b810ee7ad5b3e4855 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:46.732928  3997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80c25035ddbd458b810ee7ad5b3e4855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.729957  4140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1502de7867d7495bb2a73420c7190153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.727479  3996 tablet_service.cc:1511] Processing CreateTablet for tablet 7183afdd01454a648af43ec00011d369 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:46.745626  3998 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8fedb0755e4ee086e2a983e5b8e4b3 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:46.746083  3995 tablet_service.cc:1511] Processing CreateTablet for tablet 2c1b46cfb77a4d70863c1df111a27523 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:46.748118  3993 tablet_service.cc:1511] Processing CreateTablet for tablet 3d1b4e857aff48e296a9a69c27a84ac2 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:46.752942  3994 tablet_service.cc:1511] Processing CreateTablet for tablet d72d31ebf33b4960ac55664142d46f32 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:46.755147  3992 tablet_service.cc:1511] Processing CreateTablet for tablet db3bdead2b554329a75fc42e9c661425 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:46.761332  3996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7183afdd01454a648af43ec00011d369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.769415  3991 tablet_service.cc:1511] Processing CreateTablet for tablet 9db9913c3c0e4ff4ae3afb2a1446a948 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:46.776271  3990 tablet_service.cc:1511] Processing CreateTablet for tablet 1502de7867d7495bb2a73420c7190153 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:46.776154  3995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c1b46cfb77a4d70863c1df111a27523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.787626  3990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1502de7867d7495bb2a73420c7190153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.794488  3992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db3bdead2b554329a75fc42e9c661425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.806094  3991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db9913c3c0e4ff4ae3afb2a1446a948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.809983  3993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d1b4e857aff48e296a9a69c27a84ac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.811121  3994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72d31ebf33b4960ac55664142d46f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.818111  3998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8fedb0755e4ee086e2a983e5b8e4b3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:46.841831  3953 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:46.889384  4071 tablet_service.cc:1511] Processing CreateTablet for tablet 2c1b46cfb77a4d70863c1df111a27523 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:46.887622  4074 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8fedb0755e4ee086e2a983e5b8e4b3 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:46.884507  4073 tablet_service.cc:1511] Processing CreateTablet for tablet 80c25035ddbd458b810ee7ad5b3e4855 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:46.903136  4071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c1b46cfb77a4d70863c1df111a27523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.908367  4068 tablet_service.cc:1511] Processing CreateTablet for tablet db3bdead2b554329a75fc42e9c661425 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:46.884390  4072 tablet_service.cc:1511] Processing CreateTablet for tablet 7183afdd01454a648af43ec00011d369 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:46.903584  4070 tablet_service.cc:1511] Processing CreateTablet for tablet d72d31ebf33b4960ac55664142d46f32 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:46.909420  4069 tablet_service.cc:1511] Processing CreateTablet for tablet 3d1b4e857aff48e296a9a69c27a84ac2 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:46.915838  4066 tablet_service.cc:1511] Processing CreateTablet for tablet 1502de7867d7495bb2a73420c7190153 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:46.914075  4067 tablet_service.cc:1511] Processing CreateTablet for tablet 9db9913c3c0e4ff4ae3afb2a1446a948 (DEFAULT_TABLE table=test-workload [id=7deadd94a18f439795f313880d45486d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:46.920753  4201 tablet_bootstrap.cc:492] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8: Bootstrap starting.
I20260709 12:24:46.934211  4074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8fedb0755e4ee086e2a983e5b8e4b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.949041  4072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7183afdd01454a648af43ec00011d369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.954876  4069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d1b4e857aff48e296a9a69c27a84ac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.957202  4068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db3bdead2b554329a75fc42e9c661425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.962850  4067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db9913c3c0e4ff4ae3afb2a1446a948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.969746  4070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72d31ebf33b4960ac55664142d46f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.971873  4066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1502de7867d7495bb2a73420c7190153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.985086  4073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80c25035ddbd458b810ee7ad5b3e4855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:46.988152  4202 tablet_bootstrap.cc:492] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624: Bootstrap starting.
I20260709 12:24:47.017911  4203 tablet_bootstrap.cc:492] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c: Bootstrap starting.
I20260709 12:24:47.030680  4202 tablet_bootstrap.cc:654] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.058676  4203 tablet_bootstrap.cc:654] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.062182  4202 tablet_bootstrap.cc:492] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624: No bootstrap required, opened a new log
I20260709 12:24:47.062628  4201 tablet_bootstrap.cc:654] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.062708  4202 ts_tablet_manager.cc:1403] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624: Time spent bootstrapping tablet: real 0.075s	user 0.000s	sys 0.016s
I20260709 12:24:47.071018  4202 raft_consensus.cc:359] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.072714  4202 raft_consensus.cc:385] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.073074  4202 raft_consensus.cc:740] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.074067  4202 consensus_queue.cc:260] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.078177  4203 tablet_bootstrap.cc:492] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c: No bootstrap required, opened a new log
I20260709 12:24:47.078687  4203 ts_tablet_manager.cc:1403] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.000s
I20260709 12:24:47.086066  4203 raft_consensus.cc:359] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.087138  4203 raft_consensus.cc:385] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.087481  4203 raft_consensus.cc:740] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.088305  4203 consensus_queue.cc:260] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.091326  4202 ts_tablet_manager.cc:1434] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624: Time spent starting tablet: real 0.028s	user 0.000s	sys 0.012s
I20260709 12:24:47.093025  4202 tablet_bootstrap.cc:492] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624: Bootstrap starting.
I20260709 12:24:47.097990  4034 heartbeater.cc:499] Master 127.3.200.126:42665 was elected leader, sending a full tablet report...
I20260709 12:24:47.101609  4201 tablet_bootstrap.cc:492] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8: No bootstrap required, opened a new log
I20260709 12:24:47.102205  4201 ts_tablet_manager.cc:1403] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8: Time spent bootstrapping tablet: real 0.215s	user 0.014s	sys 0.017s
I20260709 12:24:47.105998  4202 tablet_bootstrap.cc:654] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.114789  4109 heartbeater.cc:499] Master 127.3.200.126:42665 was elected leader, sending a full tablet report...
I20260709 12:24:47.121467  4201 raft_consensus.cc:359] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.122438  4201 raft_consensus.cc:385] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.122866  4201 raft_consensus.cc:740] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.123775  4201 consensus_queue.cc:260] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.127240  4203 ts_tablet_manager.cc:1434] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c: Time spent starting tablet: real 0.048s	user 0.018s	sys 0.015s
I20260709 12:24:47.130550  4203 tablet_bootstrap.cc:492] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c: Bootstrap starting.
I20260709 12:24:47.134721  4183 heartbeater.cc:499] Master 127.3.200.126:42665 was elected leader, sending a full tablet report...
I20260709 12:24:47.142994  4201 ts_tablet_manager.cc:1434] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:24:47.144033  4201 tablet_bootstrap.cc:492] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8: Bootstrap starting.
W20260709 12:24:47.145277  4035 tablet.cc:2406] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:24:47.157734  4203 tablet_bootstrap.cc:654] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.159528  4201 tablet_bootstrap.cc:654] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.162949  4202 tablet_bootstrap.cc:492] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624: No bootstrap required, opened a new log
I20260709 12:24:47.163509  4202 ts_tablet_manager.cc:1403] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624: Time spent bootstrapping tablet: real 0.071s	user 0.035s	sys 0.012s
I20260709 12:24:47.166786  4202 raft_consensus.cc:359] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.167611  4202 raft_consensus.cc:385] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.167948  4202 raft_consensus.cc:740] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.171535  4202 consensus_queue.cc:260] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.177973  4202 ts_tablet_manager.cc:1434] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:24:47.178992  4202 tablet_bootstrap.cc:492] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624: Bootstrap starting.
I20260709 12:24:47.193120  4201 tablet_bootstrap.cc:492] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8: No bootstrap required, opened a new log
I20260709 12:24:47.193389  4203 tablet_bootstrap.cc:492] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c: No bootstrap required, opened a new log
I20260709 12:24:47.193706  4201 ts_tablet_manager.cc:1403] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.007s
I20260709 12:24:47.193989  4203 ts_tablet_manager.cc:1403] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c: Time spent bootstrapping tablet: real 0.064s	user 0.007s	sys 0.013s
I20260709 12:24:47.197232  4203 raft_consensus.cc:359] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.198052  4203 raft_consensus.cc:385] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.198392  4203 raft_consensus.cc:740] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.199174  4203 consensus_queue.cc:260] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.197032  4201 raft_consensus.cc:359] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.200834  4201 raft_consensus.cc:385] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.201213  4201 raft_consensus.cc:740] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.200860  4202 tablet_bootstrap.cc:654] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.202049  4201 consensus_queue.cc:260] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.205714  4203 ts_tablet_manager.cc:1434] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:24:47.206810  4203 tablet_bootstrap.cc:492] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c: Bootstrap starting.
I20260709 12:24:47.208478  4210 raft_consensus.cc:493] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.209023  4210 raft_consensus.cc:515] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.213447  4210 leader_election.cc:290] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915)
I20260709 12:24:47.219213  4201 ts_tablet_manager.cc:1434] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 12:24:47.222417  4201 tablet_bootstrap.cc:492] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8: Bootstrap starting.
I20260709 12:24:47.237799  4201 tablet_bootstrap.cc:654] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.240015  4202 tablet_bootstrap.cc:492] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624: No bootstrap required, opened a new log
I20260709 12:24:47.240626  4202 ts_tablet_manager.cc:1403] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.008s
I20260709 12:24:47.243203  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db9913c3c0e4ff4ae3afb2a1446a948" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b10efe7f4e34d9d84606f74160c6624" is_pre_election: true
I20260709 12:24:47.244102  4008 raft_consensus.cc:2468] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04d87c7382a4441da74afbdaee7db6f8 in term 0.
I20260709 12:24:47.245896  4121 leader_election.cc:304] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624; no voters: 
I20260709 12:24:47.246803  4210 raft_consensus.cc:2804] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:47.247192  4210 raft_consensus.cc:493] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.247597  4210 raft_consensus.cc:3060] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.244916  4202 raft_consensus.cc:359] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.248203  4202 raft_consensus.cc:385] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.248577  4202 raft_consensus.cc:740] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.249418  4202 consensus_queue.cc:260] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.250391  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db9913c3c0e4ff4ae3afb2a1446a948" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" is_pre_election: true
I20260709 12:24:47.251160  4203 tablet_bootstrap.cc:654] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:47.252674  4122 leader_election.cc:343] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.255882  4210 raft_consensus.cc:515] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.258147  4210 leader_election.cc:290] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 election: Requested vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915)
I20260709 12:24:47.258850  4202 ts_tablet_manager.cc:1434] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:24:47.259966  4202 tablet_bootstrap.cc:492] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624: Bootstrap starting.
I20260709 12:24:47.262156  4201 tablet_bootstrap.cc:492] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8: No bootstrap required, opened a new log
I20260709 12:24:47.265390  4201 ts_tablet_manager.cc:1403] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.004s
I20260709 12:24:47.262789  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db9913c3c0e4ff4ae3afb2a1446a948" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
I20260709 12:24:47.264037  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db9913c3c0e4ff4ae3afb2a1446a948" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
I20260709 12:24:47.266682  4008 raft_consensus.cc:3060] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.267318  4202 tablet_bootstrap.cc:654] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:47.267692  4122 leader_election.cc:343] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.268831  4201 raft_consensus.cc:359] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.269698  4201 raft_consensus.cc:385] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.264823  4203 tablet_bootstrap.cc:492] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c: No bootstrap required, opened a new log
I20260709 12:24:47.270778  4203 ts_tablet_manager.cc:1403] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.005s
I20260709 12:24:47.270026  4201 raft_consensus.cc:740] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.273041  4201 consensus_queue.cc:260] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.275573  4201 ts_tablet_manager.cc:1434] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:24:47.276597  4201 tablet_bootstrap.cc:492] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8: Bootstrap starting.
I20260709 12:24:47.284078  4202 tablet_bootstrap.cc:492] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624: No bootstrap required, opened a new log
I20260709 12:24:47.286334  4201 tablet_bootstrap.cc:654] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.289603  4202 ts_tablet_manager.cc:1403] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.015s
I20260709 12:24:47.288128  4203 raft_consensus.cc:359] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.288936  4008 raft_consensus.cc:2468] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04d87c7382a4441da74afbdaee7db6f8 in term 1.
I20260709 12:24:47.292810  4203 raft_consensus.cc:385] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.293184  4203 raft_consensus.cc:740] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.293681  4121 leader_election.cc:304] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624; no voters: a4d2a27c4d354c05b90ef41591eceb9c
I20260709 12:24:47.294063  4202 raft_consensus.cc:359] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } }
I20260709 12:24:47.295022  4202 raft_consensus.cc:385] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.295469  4202 raft_consensus.cc:740] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.294631  4210 raft_consensus.cc:2804] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:47.294010  4203 consensus_queue.cc:260] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.300012  4203 ts_tablet_manager.cc:1434] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:24:47.302572  4201 tablet_bootstrap.cc:492] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8: No bootstrap required, opened a new log
I20260709 12:24:47.304191  4202 consensus_queue.cc:260] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } }
I20260709 12:24:47.303922  4201 ts_tablet_manager.cc:1403] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.009s
I20260709 12:24:47.305927  4203 tablet_bootstrap.cc:492] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c: Bootstrap starting.
I20260709 12:24:47.308974  4202 ts_tablet_manager.cc:1434] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 12:24:47.310128  4202 tablet_bootstrap.cc:492] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624: Bootstrap starting.
I20260709 12:24:47.313365  4201 raft_consensus.cc:359] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } }
I20260709 12:24:47.314381  4201 raft_consensus.cc:385] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.314759  4201 raft_consensus.cc:740] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.315819  4201 consensus_queue.cc:260] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } }
I20260709 12:24:47.306335  4210 raft_consensus.cc:697] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 LEADER]: Becoming Leader. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Running, Role: LEADER
I20260709 12:24:47.318107  4210 consensus_queue.cc:237] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.331142  4203 tablet_bootstrap.cc:654] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.335764  4202 tablet_bootstrap.cc:654] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.346939  4201 ts_tablet_manager.cc:1434] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.022s
I20260709 12:24:47.348102  4201 tablet_bootstrap.cc:492] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8: Bootstrap starting.
I20260709 12:24:47.349648  3901 catalog_manager.cc:5697] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "04d87c7382a4441da74afbdaee7db6f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:47.355968  4201 tablet_bootstrap.cc:654] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.358951  4208 raft_consensus.cc:493] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.359607  4208 raft_consensus.cc:515] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.364109  4208 leader_election.cc:290] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:47.379207  4206 raft_consensus.cc:493] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.379913  4206 raft_consensus.cc:515] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.385895  4201 tablet_bootstrap.cc:492] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8: No bootstrap required, opened a new log
I20260709 12:24:47.385998  4206 leader_election.cc:290] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:47.386531  4201 ts_tablet_manager.cc:1403] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.006s
I20260709 12:24:47.396682  4201 raft_consensus.cc:359] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.397568  4201 raft_consensus.cc:385] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.397904  4201 raft_consensus.cc:740] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.401259  4201 consensus_queue.cc:260] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.406140  4201 ts_tablet_manager.cc:1434] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:24:47.407462  4201 tablet_bootstrap.cc:492] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8: Bootstrap starting.
I20260709 12:24:47.408329  4210 raft_consensus.cc:493] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.409004  4210 raft_consensus.cc:515] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.413607  4210 leader_election.cc:290] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915)
I20260709 12:24:47.413822  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1b4e857aff48e296a9a69c27a84ac2" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b10efe7f4e34d9d84606f74160c6624" is_pre_election: true
W20260709 12:24:47.415467  4121 leader_election.cc:343] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.432230  4206 raft_consensus.cc:493] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.433032  4206 raft_consensus.cc:515] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } }
I20260709 12:24:47.434594  4201 tablet_bootstrap.cc:654] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.435719  4206 leader_election.cc:290] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475), a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915)
I20260709 12:24:47.441411  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1b4e857aff48e296a9a69c27a84ac2" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" is_pre_election: true
W20260709 12:24:47.442859  4122 leader_election.cc:343] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.443472  4122 leader_election.cc:304] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8; no voters: 1b10efe7f4e34d9d84606f74160c6624, a4d2a27c4d354c05b90ef41591eceb9c
I20260709 12:24:47.444501  4210 raft_consensus.cc:2749] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:47.455355  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b46cfb77a4d70863c1df111a27523" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b10efe7f4e34d9d84606f74160c6624" is_pre_election: true
I20260709 12:24:47.455766  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7183afdd01454a648af43ec00011d369" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d87c7382a4441da74afbdaee7db6f8" is_pre_election: true
I20260709 12:24:47.457823  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8fedb0755e4ee086e2a983e5b8e4b3" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d87c7382a4441da74afbdaee7db6f8" is_pre_election: true
I20260709 12:24:47.458459  4158 raft_consensus.cc:2468] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 0.
W20260709 12:24:47.459657  4047 leader_election.cc:343] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:47.460168  3972 leader_election.cc:343] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.460877  3972 leader_election.cc:304] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624; no voters: 
I20260709 12:24:47.461706  4206 raft_consensus.cc:2804] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:47.462076  4206 raft_consensus.cc:493] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.462411  4206 raft_consensus.cc:3060] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.462586  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7183afdd01454a648af43ec00011d369" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" is_pre_election: true
I20260709 12:24:47.464210  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8fedb0755e4ee086e2a983e5b8e4b3" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" is_pre_election: true
I20260709 12:24:47.468597  4202 tablet_bootstrap.cc:492] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624: No bootstrap required, opened a new log
I20260709 12:24:47.469350  4202 ts_tablet_manager.cc:1403] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624: Time spent bootstrapping tablet: real 0.159s	user 0.041s	sys 0.056s
I20260709 12:24:47.469871  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b46cfb77a4d70863c1df111a27523" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d87c7382a4441da74afbdaee7db6f8" is_pre_election: true
I20260709 12:24:47.470902  4158 raft_consensus.cc:2468] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 0.
I20260709 12:24:47.471333  4203 tablet_bootstrap.cc:492] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c: No bootstrap required, opened a new log
I20260709 12:24:47.471784  4203 ts_tablet_manager.cc:1403] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c: Time spent bootstrapping tablet: real 0.166s	user 0.011s	sys 0.012s
I20260709 12:24:47.472826  4048 leader_election.cc:304] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, a4d2a27c4d354c05b90ef41591eceb9c; no voters: 1b10efe7f4e34d9d84606f74160c6624
I20260709 12:24:47.480293  4208 raft_consensus.cc:2804] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:47.480733  4208 raft_consensus.cc:493] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.481083  4208 raft_consensus.cc:3060] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.483083  4206 raft_consensus.cc:515] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } }
I20260709 12:24:47.483651  4202 raft_consensus.cc:359] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.484344  4202 raft_consensus.cc:385] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:24:47.484735  3972 leader_election.cc:343] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.485987  4202 raft_consensus.cc:740] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.487020  4206 leader_election.cc:290] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 election: Requested vote from peers 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475), a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915)
I20260709 12:24:47.486267  3972 leader_election.cc:304] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b10efe7f4e34d9d84606f74160c6624; no voters: 04d87c7382a4441da74afbdaee7db6f8, a4d2a27c4d354c05b90ef41591eceb9c
I20260709 12:24:47.487967  4202 consensus_queue.cc:260] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
W20260709 12:24:47.488739  3972 leader_election.cc:343] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.491171  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8fedb0755e4ee086e2a983e5b8e4b3" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:24:47.491953  4158 raft_consensus.cc:3060] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.489645  4206 raft_consensus.cc:2749] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:47.500115  4158 raft_consensus.cc:2468] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 1.
I20260709 12:24:47.501328  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8fedb0755e4ee086e2a983e5b8e4b3" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
I20260709 12:24:47.502584  4203 raft_consensus.cc:359] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.491674  4208 raft_consensus.cc:515] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.507424  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b46cfb77a4d70863c1df111a27523" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
W20260709 12:24:47.503132  3972 leader_election.cc:343] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.513237  4208 leader_election.cc:290] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 election: Requested vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:47.514667  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b46cfb77a4d70863c1df111a27523" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:24:47.503284  4203 raft_consensus.cc:385] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.514875  3972 leader_election.cc:304] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624; no voters: a4d2a27c4d354c05b90ef41591eceb9c
I20260709 12:24:47.517557  4208 raft_consensus.cc:493] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.517874  4203 raft_consensus.cc:740] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.517598  4158 raft_consensus.cc:3060] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.519380  4237 raft_consensus.cc:2804] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:47.518487  4208 raft_consensus.cc:515] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.519520  4203 consensus_queue.cc:260] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.521802  4202 ts_tablet_manager.cc:1434] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624: Time spent starting tablet: real 0.052s	user 0.017s	sys 0.017s
I20260709 12:24:47.522217  4237 raft_consensus.cc:697] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 LEADER]: Becoming Leader. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Running, Role: LEADER
I20260709 12:24:47.524539  4202 tablet_bootstrap.cc:492] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624: Bootstrap starting.
I20260709 12:24:47.525547  4208 leader_election.cc:290] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
W20260709 12:24:47.524633  4047 leader_election.cc:343] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.523553  4237 consensus_queue.cc:237] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } }
I20260709 12:24:47.528856  4157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c25035ddbd458b810ee7ad5b3e4855" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d87c7382a4441da74afbdaee7db6f8" is_pre_election: true
W20260709 12:24:47.530745  4048 leader_election.cc:343] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.533524  4203 ts_tablet_manager.cc:1434] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c: Time spent starting tablet: real 0.061s	user 0.003s	sys 0.007s
I20260709 12:24:47.535420  4203 tablet_bootstrap.cc:492] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c: Bootstrap starting.
I20260709 12:24:47.535776  4201 tablet_bootstrap.cc:492] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8: No bootstrap required, opened a new log
I20260709 12:24:47.536401  4201 ts_tablet_manager.cc:1403] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8: Time spent bootstrapping tablet: real 0.129s	user 0.006s	sys 0.021s
I20260709 12:24:47.533782  4158 raft_consensus.cc:2468] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 1.
I20260709 12:24:47.538585  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c25035ddbd458b810ee7ad5b3e4855" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b10efe7f4e34d9d84606f74160c6624" is_pre_election: true
I20260709 12:24:47.539206  4008 raft_consensus.cc:2468] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 0.
I20260709 12:24:47.539170  4048 leader_election.cc:304] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, a4d2a27c4d354c05b90ef41591eceb9c; no voters: 1b10efe7f4e34d9d84606f74160c6624
I20260709 12:24:47.539294  4201 raft_consensus.cc:359] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.540156  4208 raft_consensus.cc:493] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.540271  4201 raft_consensus.cc:385] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.541086  4202 tablet_bootstrap.cc:654] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.540645  4208 raft_consensus.cc:515] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.543013  4208 leader_election.cc:290] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:47.543529  4208 raft_consensus.cc:2804] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:47.543661  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db3bdead2b554329a75fc42e9c661425" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b10efe7f4e34d9d84606f74160c6624" is_pre_election: true
I20260709 12:24:47.543982  4208 raft_consensus.cc:697] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 LEADER]: Becoming Leader. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:24:47.544306  4008 raft_consensus.cc:2468] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 0.
I20260709 12:24:47.544827  4208 consensus_queue.cc:237] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.540652  4201 raft_consensus.cc:740] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.546821  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db3bdead2b554329a75fc42e9c661425" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d87c7382a4441da74afbdaee7db6f8" is_pre_election: true
I20260709 12:24:47.548345  4047 leader_election.cc:304] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b10efe7f4e34d9d84606f74160c6624, a4d2a27c4d354c05b90ef41591eceb9c; no voters: 04d87c7382a4441da74afbdaee7db6f8
I20260709 12:24:47.550926  4238 raft_consensus.cc:2804] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:47.551456  4238 raft_consensus.cc:493] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.551932  4238 raft_consensus.cc:3060] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.557605  4047 leader_election.cc:304] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b10efe7f4e34d9d84606f74160c6624, a4d2a27c4d354c05b90ef41591eceb9c; no voters: 
I20260709 12:24:47.566337  4201 consensus_queue.cc:260] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.567453  4158 raft_consensus.cc:2468] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 0.
I20260709 12:24:47.569996  3901 catalog_manager.cc:5697] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "1b10efe7f4e34d9d84606f74160c6624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:47.581151  4203 tablet_bootstrap.cc:654] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.587605  4201 ts_tablet_manager.cc:1434] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8: Time spent starting tablet: real 0.051s	user 0.003s	sys 0.009s
I20260709 12:24:47.588454  4238 raft_consensus.cc:515] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.589569  4240 raft_consensus.cc:2804] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:47.590057  4240 raft_consensus.cc:493] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.591885  4240 raft_consensus.cc:3060] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.591992  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c25035ddbd458b810ee7ad5b3e4855" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:24:47.592262  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c25035ddbd458b810ee7ad5b3e4855" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
I20260709 12:24:47.592654  4238 leader_election.cc:290] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 election: Requested vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:47.593024  4008 raft_consensus.cc:3060] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:47.593693  4048 leader_election.cc:343] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.593178  4238 raft_consensus.cc:493] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.597896  4238 raft_consensus.cc:515] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.600255  4238 leader_election.cc:290] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:47.601326  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db9913c3c0e4ff4ae3afb2a1446a948" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d87c7382a4441da74afbdaee7db6f8" is_pre_election: true
I20260709 12:24:47.602828  4202 tablet_bootstrap.cc:492] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624: No bootstrap required, opened a new log
I20260709 12:24:47.603564  4202 ts_tablet_manager.cc:1403] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624: Time spent bootstrapping tablet: real 0.080s	user 0.025s	sys 0.017s
I20260709 12:24:47.603117  4201 tablet_bootstrap.cc:492] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8: Bootstrap starting.
I20260709 12:24:47.624830  4008 raft_consensus.cc:2468] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 1.
I20260709 12:24:47.626652  4202 raft_consensus.cc:359] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.627388  4202 raft_consensus.cc:385] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.627681  4202 raft_consensus.cc:740] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.628412  4202 consensus_queue.cc:260] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.630640  4202 ts_tablet_manager.cc:1434] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.002s
I20260709 12:24:47.631647  4202 tablet_bootstrap.cc:492] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624: Bootstrap starting.
I20260709 12:24:47.631726  4201 tablet_bootstrap.cc:654] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.633565  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db9913c3c0e4ff4ae3afb2a1446a948" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b10efe7f4e34d9d84606f74160c6624" is_pre_election: true
I20260709 12:24:47.634452  4008 raft_consensus.cc:2393] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4d2a27c4d354c05b90ef41591eceb9c in current term 1: Already voted for candidate 04d87c7382a4441da74afbdaee7db6f8 in this term.
I20260709 12:24:47.636756  4240 raft_consensus.cc:515] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.637862  4210 raft_consensus.cc:493] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.638356  4210 raft_consensus.cc:515] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.639762  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db3bdead2b554329a75fc42e9c661425" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:24:47.640292  4158 raft_consensus.cc:3060] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.640375  4210 leader_election.cc:290] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915)
I20260709 12:24:47.642346  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db3bdead2b554329a75fc42e9c661425" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
I20260709 12:24:47.643023  4007 raft_consensus.cc:3060] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.643564  3901 catalog_manager.cc:5697] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c reported cstate change: term changed from 0 to 1, leader changed from <none> to a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66). New cstate: current_term: 1 leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:47.645961  4158 raft_consensus.cc:2468] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 1.
I20260709 12:24:47.646425  4240 leader_election.cc:290] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 election: Requested vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:47.646785  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72d31ebf33b4960ac55664142d46f32" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b10efe7f4e34d9d84606f74160c6624" is_pre_election: true
I20260709 12:24:47.647094  4048 leader_election.cc:304] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, a4d2a27c4d354c05b90ef41591eceb9c; no voters: 
I20260709 12:24:47.648097  4240 raft_consensus.cc:2804] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:47.650805  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72d31ebf33b4960ac55664142d46f32" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" is_pre_election: true
I20260709 12:24:47.651125  4240 raft_consensus.cc:697] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 LEADER]: Becoming Leader. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:24:47.651292  4202 tablet_bootstrap.cc:654] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:47.648033  4121 leader_election.cc:343] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.651894  4047 leader_election.cc:304] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b10efe7f4e34d9d84606f74160c6624, a4d2a27c4d354c05b90ef41591eceb9c; no voters: 04d87c7382a4441da74afbdaee7db6f8
I20260709 12:24:47.652886  4243 raft_consensus.cc:2804] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:47.653123  4047 leader_election.cc:304] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d2a27c4d354c05b90ef41591eceb9c; no voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624
I20260709 12:24:47.653352  4243 raft_consensus.cc:697] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 LEADER]: Becoming Leader. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:24:47.649957  4007 raft_consensus.cc:2468] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 1.
I20260709 12:24:47.654232  4243 consensus_queue.cc:237] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.657444  4203 tablet_bootstrap.cc:492] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c: No bootstrap required, opened a new log
I20260709 12:24:47.657871  4203 ts_tablet_manager.cc:1403] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c: Time spent bootstrapping tablet: real 0.123s	user 0.008s	sys 0.015s
I20260709 12:24:47.652026  4240 consensus_queue.cc:237] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.659750  4208 raft_consensus.cc:3060] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:47.660423  4122 leader_election.cc:343] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.660849  4122 leader_election.cc:304] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8; no voters: 1b10efe7f4e34d9d84606f74160c6624, a4d2a27c4d354c05b90ef41591eceb9c
I20260709 12:24:47.661772  4210 raft_consensus.cc:2749] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:47.667797  4208 raft_consensus.cc:2749] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:47.669603  4202 tablet_bootstrap.cc:492] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624: No bootstrap required, opened a new log
I20260709 12:24:47.670150  4202 ts_tablet_manager.cc:1403] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.009s
I20260709 12:24:47.672470  4203 raft_consensus.cc:359] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.673676  4201 tablet_bootstrap.cc:492] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8: No bootstrap required, opened a new log
I20260709 12:24:47.673588  4203 raft_consensus.cc:385] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.674232  4201 ts_tablet_manager.cc:1403] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8: Time spent bootstrapping tablet: real 0.077s	user 0.006s	sys 0.008s
I20260709 12:24:47.674235  4203 raft_consensus.cc:740] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.674526  4202 raft_consensus.cc:359] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.675313  4202 raft_consensus.cc:385] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.675546  4203 consensus_queue.cc:260] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.677527  4201 raft_consensus.cc:359] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.678478  4201 raft_consensus.cc:385] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.678861  4201 raft_consensus.cc:740] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.679910  4203 ts_tablet_manager.cc:1434] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 12:24:47.680078  4201 consensus_queue.cc:260] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.681716  4203 tablet_bootstrap.cc:492] T 1502de7867d7495bb2a73420c7190153 P a4d2a27c4d354c05b90ef41591eceb9c: Bootstrap starting.
I20260709 12:24:47.675622  4202 raft_consensus.cc:740] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.685039  4201 ts_tablet_manager.cc:1434] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:24:47.685787  4201 tablet_bootstrap.cc:492] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8: Bootstrap starting.
I20260709 12:24:47.688743  4202 consensus_queue.cc:260] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.691998  4206 raft_consensus.cc:493] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.692857  4206 raft_consensus.cc:515] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.694221  4202 ts_tablet_manager.cc:1434] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:24:47.697115  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72d31ebf33b4960ac55664142d46f32" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" is_pre_election: true
W20260709 12:24:47.698534  3972 leader_election.cc:343] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.700464  4206 leader_election.cc:290] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:47.702793  4202 tablet_bootstrap.cc:492] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624: Bootstrap starting.
I20260709 12:24:47.703105  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72d31ebf33b4960ac55664142d46f32" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d87c7382a4441da74afbdaee7db6f8" is_pre_election: true
I20260709 12:24:47.698957  3904 catalog_manager.cc:5697] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c reported cstate change: term changed from 0 to 1, leader changed from <none> to a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66). New cstate: current_term: 1 leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:47.705004  4158 raft_consensus.cc:2468] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 0.
I20260709 12:24:47.709028  4201 tablet_bootstrap.cc:654] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.710816  3972 leader_election.cc:304] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624; no voters: a4d2a27c4d354c05b90ef41591eceb9c
I20260709 12:24:47.713279  4206 raft_consensus.cc:2804] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:47.714537  4206 raft_consensus.cc:493] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.714972  4206 raft_consensus.cc:3060] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.715068  3904 catalog_manager.cc:5697] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c reported cstate change: term changed from 0 to 1, leader changed from <none> to a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66). New cstate: current_term: 1 leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:47.713863  4210 consensus_queue.cc:1048] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:47.717159  4203 tablet_bootstrap.cc:654] T 1502de7867d7495bb2a73420c7190153 P a4d2a27c4d354c05b90ef41591eceb9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.726922  4201 tablet_bootstrap.cc:492] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8: No bootstrap required, opened a new log
I20260709 12:24:47.727386  4201 ts_tablet_manager.cc:1403] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.003s
I20260709 12:24:47.731292  4202 tablet_bootstrap.cc:654] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.731578  4201 raft_consensus.cc:359] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.729319  4206 raft_consensus.cc:515] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.732214  4201 raft_consensus.cc:385] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.732507  4201 raft_consensus.cc:740] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.733174  4201 consensus_queue.cc:260] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.738540  4201 ts_tablet_manager.cc:1434] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:24:47.738360  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72d31ebf33b4960ac55664142d46f32" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
I20260709 12:24:47.740926  4201 tablet_bootstrap.cc:492] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8: Bootstrap starting.
I20260709 12:24:47.738991  4206 leader_election.cc:290] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 election: Requested vote from peers a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:47.739667  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72d31ebf33b4960ac55664142d46f32" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
W20260709 12:24:47.742173  3972 leader_election.cc:343] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.742408  4158 raft_consensus.cc:3060] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.749341  4206 raft_consensus.cc:493] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.749795  4206 raft_consensus.cc:515] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.753132  4206 leader_election.cc:290] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:47.753322  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1502de7867d7495bb2a73420c7190153" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" is_pre_election: true
I20260709 12:24:47.753767  4157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1502de7867d7495bb2a73420c7190153" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d87c7382a4441da74afbdaee7db6f8" is_pre_election: true
W20260709 12:24:47.755210  3972 leader_election.cc:343] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.758392  4202 tablet_bootstrap.cc:492] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624: No bootstrap required, opened a new log
I20260709 12:24:47.758909  4202 ts_tablet_manager.cc:1403] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.004s
I20260709 12:24:47.755630  4158 raft_consensus.cc:2468] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 1.
I20260709 12:24:47.762696  4202 raft_consensus.cc:359] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.764227  4202 raft_consensus.cc:385] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.764856  4202 raft_consensus.cc:740] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.765082  4221 raft_consensus.cc:493] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.765622  3972 leader_election.cc:304] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624; no voters: a4d2a27c4d354c05b90ef41591eceb9c
I20260709 12:24:47.765663  4221 raft_consensus.cc:515] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.766556  4206 raft_consensus.cc:2804] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:47.767012  4206 raft_consensus.cc:697] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 LEADER]: Becoming Leader. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Running, Role: LEADER
W20260709 12:24:47.766917  3972 leader_election.cc:343] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.767876  4221 leader_election.cc:290] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915)
I20260709 12:24:47.767823  4206 consensus_queue.cc:237] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.769037  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c25035ddbd458b810ee7ad5b3e4855" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" is_pre_election: true
I20260709 12:24:47.769975  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c25035ddbd458b810ee7ad5b3e4855" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b10efe7f4e34d9d84606f74160c6624" is_pre_election: true
I20260709 12:24:47.770282  4203 tablet_bootstrap.cc:492] T 1502de7867d7495bb2a73420c7190153 P a4d2a27c4d354c05b90ef41591eceb9c: No bootstrap required, opened a new log
I20260709 12:24:47.770723  4008 raft_consensus.cc:2393] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04d87c7382a4441da74afbdaee7db6f8 in current term 1: Already voted for candidate a4d2a27c4d354c05b90ef41591eceb9c in this term.
I20260709 12:24:47.770802  4203 ts_tablet_manager.cc:1403] T 1502de7867d7495bb2a73420c7190153 P a4d2a27c4d354c05b90ef41591eceb9c: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.010s
I20260709 12:24:47.768096  3972 leader_election.cc:304] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b10efe7f4e34d9d84606f74160c6624; no voters: 04d87c7382a4441da74afbdaee7db6f8, a4d2a27c4d354c05b90ef41591eceb9c
I20260709 12:24:47.772790  4237 raft_consensus.cc:2749] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:47.774503  4203 raft_consensus.cc:359] T 1502de7867d7495bb2a73420c7190153 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.775553  4203 raft_consensus.cc:385] T 1502de7867d7495bb2a73420c7190153 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.775632  4121 leader_election.cc:304] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8; no voters: 1b10efe7f4e34d9d84606f74160c6624, a4d2a27c4d354c05b90ef41591eceb9c
I20260709 12:24:47.776085  4203 raft_consensus.cc:740] T 1502de7867d7495bb2a73420c7190153 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.776950  4221 raft_consensus.cc:3060] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.780030  4201 tablet_bootstrap.cc:654] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.783658  4203 consensus_queue.cc:260] T 1502de7867d7495bb2a73420c7190153 P a4d2a27c4d354c05b90ef41591eceb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.786181  4203 ts_tablet_manager.cc:1434] T 1502de7867d7495bb2a73420c7190153 P a4d2a27c4d354c05b90ef41591eceb9c: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:24:47.787182  4203 tablet_bootstrap.cc:492] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c: Bootstrap starting.
I20260709 12:24:47.789529  4222 consensus_queue.cc:1048] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:47.800604  4221 raft_consensus.cc:2749] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:47.800324  4203 tablet_bootstrap.cc:654] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.805207  4202 consensus_queue.cc:260] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.810035  4202 ts_tablet_manager.cc:1434] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624: Time spent starting tablet: real 0.051s	user 0.001s	sys 0.003s
I20260709 12:24:47.810949  4202 tablet_bootstrap.cc:492] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624: Bootstrap starting.
I20260709 12:24:47.813874  3904 catalog_manager.cc:5697] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "1b10efe7f4e34d9d84606f74160c6624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:47.818460  4202 tablet_bootstrap.cc:654] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.822774  4201 tablet_bootstrap.cc:492] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8: No bootstrap required, opened a new log
I20260709 12:24:47.823213  4201 ts_tablet_manager.cc:1403] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8: Time spent bootstrapping tablet: real 0.082s	user 0.016s	sys 0.006s
I20260709 12:24:47.825601  4201 raft_consensus.cc:359] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.826464  4201 raft_consensus.cc:385] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.826799  4201 raft_consensus.cc:740] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.827562  4201 consensus_queue.cc:260] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.839046  4201 ts_tablet_manager.cc:1434] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:24:47.842339  4203 tablet_bootstrap.cc:492] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c: No bootstrap required, opened a new log
I20260709 12:24:47.842924  4203 ts_tablet_manager.cc:1403] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.005s
W20260709 12:24:47.846493  3953 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:47.848157  4202 tablet_bootstrap.cc:492] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624: No bootstrap required, opened a new log
I20260709 12:24:47.848644  4202 ts_tablet_manager.cc:1403] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.006s
I20260709 12:24:47.851193  4202 raft_consensus.cc:359] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.851681  4202 raft_consensus.cc:385] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.851930  4202 raft_consensus.cc:740] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.846017  4203 raft_consensus.cc:359] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.852595  4202 consensus_queue.cc:260] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.852929  4203 raft_consensus.cc:385] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.853259  4203 raft_consensus.cc:740] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.854316  4202 ts_tablet_manager.cc:1434] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:24:47.856334  4203 consensus_queue.cc:260] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.858546  4203 ts_tablet_manager.cc:1434] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:24:47.859517  4203 tablet_bootstrap.cc:492] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c: Bootstrap starting.
I20260709 12:24:47.866138  4203 tablet_bootstrap.cc:654] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.872152  4203 tablet_bootstrap.cc:492] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c: No bootstrap required, opened a new log
I20260709 12:24:47.872756  4203 ts_tablet_manager.cc:1403] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 12:24:47.875319  4203 raft_consensus.cc:359] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } }
I20260709 12:24:47.875983  4203 raft_consensus.cc:385] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.876247  4203 raft_consensus.cc:740] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.876900  4203 consensus_queue.cc:260] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } }
I20260709 12:24:47.878829  4203 ts_tablet_manager.cc:1434] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:47.880081  4203 tablet_bootstrap.cc:492] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c: Bootstrap starting.
I20260709 12:24:47.882817  4221 raft_consensus.cc:493] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.883271  4221 raft_consensus.cc:515] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.885320  4221 leader_election.cc:290] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915)
I20260709 12:24:47.886070  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7183afdd01454a648af43ec00011d369" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b10efe7f4e34d9d84606f74160c6624" is_pre_election: true
I20260709 12:24:47.886732  4007 raft_consensus.cc:2468] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04d87c7382a4441da74afbdaee7db6f8 in term 0.
I20260709 12:24:47.887915  4121 leader_election.cc:304] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624; no voters: 
I20260709 12:24:47.888442  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7183afdd01454a648af43ec00011d369" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" is_pre_election: true
I20260709 12:24:47.888895  4203 tablet_bootstrap.cc:654] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.888846  4221 raft_consensus.cc:2804] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:47.889325  4221 raft_consensus.cc:493] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.889681  4221 raft_consensus.cc:3060] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:47.889856  4122 leader_election.cc:343] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.896344  4221 raft_consensus.cc:515] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.898473  4221 leader_election.cc:290] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 election: Requested vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915)
I20260709 12:24:47.898986  4203 tablet_bootstrap.cc:492] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c: No bootstrap required, opened a new log
I20260709 12:24:47.899423  4203 ts_tablet_manager.cc:1403] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 12:24:47.899629  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7183afdd01454a648af43ec00011d369" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
I20260709 12:24:47.900038  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7183afdd01454a648af43ec00011d369" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
I20260709 12:24:47.900266  4007 raft_consensus.cc:3060] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:47.901784  4122 leader_election.cc:343] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.901942  4203 raft_consensus.cc:359] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.902597  4203 raft_consensus.cc:385] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.902863  4203 raft_consensus.cc:740] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.903478  4203 consensus_queue.cc:260] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.905405  4203 ts_tablet_manager.cc:1434] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:24:47.907460  4007 raft_consensus.cc:2468] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04d87c7382a4441da74afbdaee7db6f8 in term 1.
I20260709 12:24:47.908720  4121 leader_election.cc:304] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624; no voters: a4d2a27c4d354c05b90ef41591eceb9c
I20260709 12:24:47.909560  4221 raft_consensus.cc:2804] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:47.910145  4221 raft_consensus.cc:697] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 LEADER]: Becoming Leader. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Running, Role: LEADER
I20260709 12:24:47.910969  4221 consensus_queue.cc:237] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.921011  3902 catalog_manager.cc:5697] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "04d87c7382a4441da74afbdaee7db6f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:47.936653  4084 raft_consensus.cc:3060] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.942713  4237 consensus_queue.cc:1048] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:47.954733  4206 consensus_queue.cc:1048] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:47.991542  4265 raft_consensus.cc:493] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.991369  4240 consensus_queue.cc:1048] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:47.992231  4265 raft_consensus.cc:515] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:47.994441  4265 leader_election.cc:290] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:47.995538  4157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1b4e857aff48e296a9a69c27a84ac2" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d87c7382a4441da74afbdaee7db6f8" is_pre_election: true
I20260709 12:24:47.995697  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1b4e857aff48e296a9a69c27a84ac2" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" is_pre_election: true
I20260709 12:24:47.996364  4157 raft_consensus.cc:2468] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 0.
I20260709 12:24:47.996575  4084 raft_consensus.cc:2468] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 0.
I20260709 12:24:47.997911  3972 leader_election.cc:304] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b10efe7f4e34d9d84606f74160c6624, a4d2a27c4d354c05b90ef41591eceb9c; no voters: 
I20260709 12:24:47.999152  4265 raft_consensus.cc:2804] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:47.999658  4265 raft_consensus.cc:493] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.000097  4265 raft_consensus.cc:3060] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.005862  4007 raft_consensus.cc:3060] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.013433  4265 raft_consensus.cc:515] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.016937  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1b4e857aff48e296a9a69c27a84ac2" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
I20260709 12:24:48.017100  4265 leader_election.cc:290] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 election: Requested vote from peers a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:48.017546  4084 raft_consensus.cc:3060] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.017710  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1b4e857aff48e296a9a69c27a84ac2" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:24:48.018388  4158 raft_consensus.cc:3060] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.024784  4084 raft_consensus.cc:2468] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 1.
I20260709 12:24:48.025403  4238 consensus_queue.cc:1048] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:48.025807  3972 leader_election.cc:304] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b10efe7f4e34d9d84606f74160c6624, a4d2a27c4d354c05b90ef41591eceb9c; no voters: 
I20260709 12:24:48.026050  4158 raft_consensus.cc:2468] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 1.
I20260709 12:24:48.026736  4265 raft_consensus.cc:2804] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:48.027696  4265 raft_consensus.cc:697] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 LEADER]: Becoming Leader. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Running, Role: LEADER
I20260709 12:24:48.028582  4265 consensus_queue.cc:237] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.037899  3902 catalog_manager.cc:5697] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "1b10efe7f4e34d9d84606f74160c6624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:48.076251  4238 consensus_queue.cc:1048] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:48.087656  4240 consensus_queue.cc:1048] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:48.126415  4240 raft_consensus.cc:493] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.126865  4240 raft_consensus.cc:515] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.128458  4240 leader_election.cc:290] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:48.129417  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72d31ebf33b4960ac55664142d46f32" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b10efe7f4e34d9d84606f74160c6624" is_pre_election: true
I20260709 12:24:48.129619  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72d31ebf33b4960ac55664142d46f32" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d87c7382a4441da74afbdaee7db6f8" is_pre_election: true
I20260709 12:24:48.130437  4158 raft_consensus.cc:2393] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4d2a27c4d354c05b90ef41591eceb9c in current term 1: Already voted for candidate 1b10efe7f4e34d9d84606f74160c6624 in this term.
I20260709 12:24:48.131404  4048 leader_election.cc:304] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d2a27c4d354c05b90ef41591eceb9c; no voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624
I20260709 12:24:48.132079  4240 raft_consensus.cc:3060] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.138785  4240 raft_consensus.cc:2749] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:48.172799  4221 raft_consensus.cc:493] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.173317  4221 raft_consensus.cc:515] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.175143  4221 leader_election.cc:290] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915)
I20260709 12:24:48.175877  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1502de7867d7495bb2a73420c7190153" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b10efe7f4e34d9d84606f74160c6624" is_pre_election: true
I20260709 12:24:48.176146  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1502de7867d7495bb2a73420c7190153" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" is_pre_election: true
I20260709 12:24:48.176528  4007 raft_consensus.cc:2468] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04d87c7382a4441da74afbdaee7db6f8 in term 0.
I20260709 12:24:48.176748  4084 raft_consensus.cc:2468] T 1502de7867d7495bb2a73420c7190153 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04d87c7382a4441da74afbdaee7db6f8 in term 0.
I20260709 12:24:48.177593  4121 leader_election.cc:304] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624; no voters: 
I20260709 12:24:48.178351  4221 raft_consensus.cc:2804] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:48.178656  4221 raft_consensus.cc:493] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.178949  4221 raft_consensus.cc:3060] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.183636  4240 consensus_queue.cc:1048] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:48.184203  4221 raft_consensus.cc:515] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.186931  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1502de7867d7495bb2a73420c7190153" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
I20260709 12:24:48.188167  4007 raft_consensus.cc:3060] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.188651  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1502de7867d7495bb2a73420c7190153" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
I20260709 12:24:48.189216  4084 raft_consensus.cc:3060] T 1502de7867d7495bb2a73420c7190153 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.195104  4007 raft_consensus.cc:2468] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04d87c7382a4441da74afbdaee7db6f8 in term 1.
I20260709 12:24:48.195595  4084 raft_consensus.cc:2468] T 1502de7867d7495bb2a73420c7190153 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04d87c7382a4441da74afbdaee7db6f8 in term 1.
I20260709 12:24:48.187619  4221 leader_election.cc:290] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 election: Requested vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915)
I20260709 12:24:48.196364  4121 leader_election.cc:304] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624; no voters: 
I20260709 12:24:48.197841  4221 raft_consensus.cc:2804] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:48.198361  4221 raft_consensus.cc:697] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 LEADER]: Becoming Leader. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Running, Role: LEADER
I20260709 12:24:48.199169  4221 consensus_queue.cc:237] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.207176  4238 consensus_queue.cc:1048] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:48.213660  3904 catalog_manager.cc:5697] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "04d87c7382a4441da74afbdaee7db6f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:48.266601  4084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80c25035ddbd458b810ee7ad5b3e4855"
dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
mode: GRACEFUL
new_leader_uuid: "1b10efe7f4e34d9d84606f74160c6624"
 from {username='slave'} at 127.0.0.1:59752
I20260709 12:24:48.267197  4084 raft_consensus.cc:606] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 LEADER]: Received request to transfer leadership to TS 1b10efe7f4e34d9d84606f74160c6624
I20260709 12:24:48.281688  4158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7183afdd01454a648af43ec00011d369"
dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
mode: GRACEFUL
new_leader_uuid: "1b10efe7f4e34d9d84606f74160c6624"
 from {username='slave'} at 127.0.0.1:49930
I20260709 12:24:48.282343  4158 raft_consensus.cc:606] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 LEADER]: Received request to transfer leadership to TS 1b10efe7f4e34d9d84606f74160c6624
I20260709 12:24:48.287875  4084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c1b46cfb77a4d70863c1df111a27523"
dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
mode: GRACEFUL
new_leader_uuid: "1b10efe7f4e34d9d84606f74160c6624"
 from {username='slave'} at 127.0.0.1:59752
I20260709 12:24:48.288396  4084 raft_consensus.cc:606] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 LEADER]: Received request to transfer leadership to TS 1b10efe7f4e34d9d84606f74160c6624
I20260709 12:24:48.294857  4265 consensus_queue.cc:1048] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:48.309499  4206 consensus_queue.cc:1048] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:48.313886  4007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d72d31ebf33b4960ac55664142d46f32"
dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
mode: GRACEFUL
new_leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
 from {username='slave'} at 127.0.0.1:60976
I20260709 12:24:48.314510  4007 raft_consensus.cc:606] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 LEADER]: Received request to transfer leadership to TS a4d2a27c4d354c05b90ef41591eceb9c
I20260709 12:24:48.322844  4007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d1b4e857aff48e296a9a69c27a84ac2"
dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
mode: GRACEFUL
new_leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
 from {username='slave'} at 127.0.0.1:60976
I20260709 12:24:48.323458  4007 raft_consensus.cc:606] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 LEADER]: Received request to transfer leadership to TS a4d2a27c4d354c05b90ef41591eceb9c
I20260709 12:24:48.334620  4158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9db9913c3c0e4ff4ae3afb2a1446a948"
dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
mode: GRACEFUL
new_leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
 from {username='slave'} at 127.0.0.1:49930
I20260709 12:24:48.335155  4158 raft_consensus.cc:606] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 LEADER]: Received request to transfer leadership to TS a4d2a27c4d354c05b90ef41591eceb9c
I20260709 12:24:48.336196  4237 raft_consensus.cc:993] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624: : Instructing follower a4d2a27c4d354c05b90ef41591eceb9c to start an election
I20260709 12:24:48.336663  4265 raft_consensus.cc:1081] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 LEADER]: Signalling peer a4d2a27c4d354c05b90ef41591eceb9c to start an election
I20260709 12:24:48.338578  4084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d72d31ebf33b4960ac55664142d46f32"
dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
 from {username='slave'} at 127.0.0.1:59740
I20260709 12:24:48.339217  4084 raft_consensus.cc:493] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:48.339650  4084 raft_consensus.cc:3060] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.345652  4084 raft_consensus.cc:515] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.347285  4084 leader_election.cc:290] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 2 election: Requested vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:48.348462  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72d31ebf33b4960ac55664142d46f32" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:24:48.349081  4158 raft_consensus.cc:3060] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.349346  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d72d31ebf33b4960ac55664142d46f32" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
I20260709 12:24:48.349941  4007 raft_consensus.cc:3055] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:48.350270  4007 raft_consensus.cc:740] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Running, Role: LEADER
I20260709 12:24:48.351184  4007 consensus_queue.cc:260] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.352685  4007 raft_consensus.cc:3060] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.356163  4158 raft_consensus.cc:2468] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 2.
I20260709 12:24:48.357452  4048 leader_election.cc:304] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, a4d2a27c4d354c05b90ef41591eceb9c; no voters: 
I20260709 12:24:48.358234  4238 raft_consensus.cc:2804] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:48.358707  4221 raft_consensus.cc:993] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8: : Instructing follower a4d2a27c4d354c05b90ef41591eceb9c to start an election
I20260709 12:24:48.358711  4238 raft_consensus.cc:697] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 LEADER]: Becoming Leader. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:24:48.359304  4221 raft_consensus.cc:1081] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 LEADER]: Signalling peer a4d2a27c4d354c05b90ef41591eceb9c to start an election
I20260709 12:24:48.359758  4238 consensus_queue.cc:237] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.361227  4084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9db9913c3c0e4ff4ae3afb2a1446a948"
dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
 from {username='slave'} at 127.0.0.1:59738
I20260709 12:24:48.361774  4084 raft_consensus.cc:493] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:48.362107  4084 raft_consensus.cc:3060] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.362807  4238 raft_consensus.cc:493] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.363235  4238 raft_consensus.cc:515] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.366089  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7183afdd01454a648af43ec00011d369" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b10efe7f4e34d9d84606f74160c6624" is_pre_election: true
I20260709 12:24:48.366834  4008 raft_consensus.cc:2393] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4d2a27c4d354c05b90ef41591eceb9c in current term 1: Already voted for candidate 04d87c7382a4441da74afbdaee7db6f8 in this term.
I20260709 12:24:48.370784  3904 catalog_manager.cc:5697] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c reported cstate change: term changed from 1 to 2, leader changed from 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65) to a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66). New cstate: current_term: 2 leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:48.371567  4007 raft_consensus.cc:2468] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 2.
I20260709 12:24:48.373577  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7183afdd01454a648af43ec00011d369" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04d87c7382a4441da74afbdaee7db6f8" is_pre_election: true
I20260709 12:24:48.371383  4084 raft_consensus.cc:515] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.372431  4238 leader_election.cc:290] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:48.374917  4048 leader_election.cc:304] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4d2a27c4d354c05b90ef41591eceb9c; no voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624
I20260709 12:24:48.376376  4238 raft_consensus.cc:3060] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.376946  4084 leader_election.cc:290] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 2 election: Requested vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:48.377658  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db9913c3c0e4ff4ae3afb2a1446a948" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:24:48.378192  4158 raft_consensus.cc:3055] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:48.378537  4158 raft_consensus.cc:740] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Running, Role: LEADER
I20260709 12:24:48.379395  4158 consensus_queue.cc:260] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.380584  4158 raft_consensus.cc:3060] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.383744  4238 raft_consensus.cc:2749] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:48.384814  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db9913c3c0e4ff4ae3afb2a1446a948" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
I20260709 12:24:48.385383  4007 raft_consensus.cc:3060] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.386794  4158 raft_consensus.cc:2468] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 2.
I20260709 12:24:48.387755  4048 leader_election.cc:304] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, a4d2a27c4d354c05b90ef41591eceb9c; no voters: 
I20260709 12:24:48.388623  4238 raft_consensus.cc:2804] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:48.389734  4238 raft_consensus.cc:697] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 LEADER]: Becoming Leader. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:24:48.390389  4238 consensus_queue.cc:237] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.392481  4007 raft_consensus.cc:2468] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 2.
I20260709 12:24:48.397274  3904 catalog_manager.cc:5697] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c reported cstate change: term changed from 1 to 2, leader changed from 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67) to a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66). New cstate: current_term: 2 leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:48.440462  4237 consensus_queue.cc:1048] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:48.452873  4206 consensus_queue.cc:1048] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:48.460947  4265 raft_consensus.cc:993] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624: : Instructing follower a4d2a27c4d354c05b90ef41591eceb9c to start an election
I20260709 12:24:48.461431  4265 raft_consensus.cc:1081] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 LEADER]: Signalling peer a4d2a27c4d354c05b90ef41591eceb9c to start an election
I20260709 12:24:48.463060  4084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d1b4e857aff48e296a9a69c27a84ac2"
dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
 from {username='slave'} at 127.0.0.1:59740
I20260709 12:24:48.463615  4084 raft_consensus.cc:493] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:48.464622  4084 raft_consensus.cc:3060] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.469033  4084 raft_consensus.cc:515] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.471596  4084 leader_election.cc:290] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 2 election: Requested vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:48.472321  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1b4e857aff48e296a9a69c27a84ac2" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
I20260709 12:24:48.473058  4007 raft_consensus.cc:3055] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:48.473407  4007 raft_consensus.cc:740] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Running, Role: LEADER
I20260709 12:24:48.473562  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1b4e857aff48e296a9a69c27a84ac2" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:24:48.474288  4158 raft_consensus.cc:3060] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.474247  4007 consensus_queue.cc:260] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.475646  4007 raft_consensus.cc:3060] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.480101  4158 raft_consensus.cc:2468] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 2.
I20260709 12:24:48.481463  4048 leader_election.cc:304] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, a4d2a27c4d354c05b90ef41591eceb9c; no voters: 
I20260709 12:24:48.482225  4243 raft_consensus.cc:2804] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:48.482613  4007 raft_consensus.cc:2468] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 2.
I20260709 12:24:48.482689  4243 raft_consensus.cc:697] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 LEADER]: Becoming Leader. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:24:48.483649  4243 consensus_queue.cc:237] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.490406  3904 catalog_manager.cc:5697] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c reported cstate change: term changed from 1 to 2, leader changed from 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65) to a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66). New cstate: current_term: 2 leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:48.520025  4221 consensus_queue.cc:1048] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:48.526780  4210 raft_consensus.cc:993] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8: : Instructing follower 1b10efe7f4e34d9d84606f74160c6624 to start an election
I20260709 12:24:48.527498  4221 raft_consensus.cc:1081] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 LEADER]: Signalling peer 1b10efe7f4e34d9d84606f74160c6624 to start an election
I20260709 12:24:48.529922  4008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7183afdd01454a648af43ec00011d369"
dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
 from {username='slave'} at 127.0.0.1:60966
I20260709 12:24:48.530500  4008 raft_consensus.cc:493] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:48.530880  4008 raft_consensus.cc:3060] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.536517  4210 consensus_queue.cc:1048] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:48.539330  4008 raft_consensus.cc:515] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.541692  4007 raft_consensus.cc:1240] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Rejecting Update request from peer 04d87c7382a4441da74afbdaee7db6f8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:48.547266  4210 consensus_queue.cc:1059] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:48.548091  4210 raft_consensus.cc:3055] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:48.548046  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7183afdd01454a648af43ec00011d369" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
I20260709 12:24:48.548573  4210 raft_consensus.cc:740] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Running, Role: LEADER
I20260709 12:24:48.548774  4084 raft_consensus.cc:3060] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.549445  4210 consensus_queue.cc:260] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.550524  4210 raft_consensus.cc:3060] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.558243  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7183afdd01454a648af43ec00011d369" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:24:48.560705  4008 leader_election.cc:290] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 2 election: Requested vote from peers a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:48.561326  4084 raft_consensus.cc:2468] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 2.
I20260709 12:24:48.563601  4158 raft_consensus.cc:2468] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 2.
I20260709 12:24:48.564642  3972 leader_election.cc:304] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624; no voters: 
I20260709 12:24:48.565420  4265 raft_consensus.cc:2804] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:48.565902  4265 raft_consensus.cc:697] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 LEADER]: Becoming Leader. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Running, Role: LEADER
I20260709 12:24:48.566699  4265 consensus_queue.cc:237] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.573084  4243 raft_consensus.cc:993] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c: : Instructing follower 1b10efe7f4e34d9d84606f74160c6624 to start an election
I20260709 12:24:48.573514  4238 raft_consensus.cc:1081] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 LEADER]: Signalling peer 1b10efe7f4e34d9d84606f74160c6624 to start an election
I20260709 12:24:48.574000  3904 catalog_manager.cc:5697] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 reported cstate change: term changed from 1 to 2, leader changed from 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67) to 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65). New cstate: current_term: 2 leader_uuid: "1b10efe7f4e34d9d84606f74160c6624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:48.574966  4008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80c25035ddbd458b810ee7ad5b3e4855"
dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
 from {username='slave'} at 127.0.0.1:60970
I20260709 12:24:48.575513  4008 raft_consensus.cc:493] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:48.575824  4008 raft_consensus.cc:3060] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.581763  4008 raft_consensus.cc:515] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.583500  4008 leader_election.cc:290] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 2 election: Requested vote from peers a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:48.584532  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c25035ddbd458b810ee7ad5b3e4855" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
I20260709 12:24:48.584807  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c25035ddbd458b810ee7ad5b3e4855" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:24:48.585168  4084 raft_consensus.cc:3055] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:48.585388  4158 raft_consensus.cc:3060] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.585528  4084 raft_consensus.cc:740] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:24:48.586335  4084 consensus_queue.cc:260] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.587237  4084 raft_consensus.cc:3060] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.593489  4158 raft_consensus.cc:2468] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 2.
I20260709 12:24:48.593477  4084 raft_consensus.cc:2468] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 2.
I20260709 12:24:48.594672  4210 consensus_queue.cc:1048] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:48.594836  3972 leader_election.cc:304] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b10efe7f4e34d9d84606f74160c6624, a4d2a27c4d354c05b90ef41591eceb9c; no voters: 
I20260709 12:24:48.595686  4265 raft_consensus.cc:2804] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:48.596153  4265 raft_consensus.cc:697] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 LEADER]: Becoming Leader. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Running, Role: LEADER
I20260709 12:24:48.596884  4265 consensus_queue.cc:237] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.606645  4240 raft_consensus.cc:993] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c: : Instructing follower 1b10efe7f4e34d9d84606f74160c6624 to start an election
I20260709 12:24:48.607085  4240 raft_consensus.cc:1081] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 LEADER]: Signalling peer 1b10efe7f4e34d9d84606f74160c6624 to start an election
I20260709 12:24:48.607111  3904 catalog_manager.cc:5697] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 reported cstate change: term changed from 1 to 2, leader changed from a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66) to 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65). New cstate: current_term: 2 leader_uuid: "1b10efe7f4e34d9d84606f74160c6624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:48.612761  4008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c1b46cfb77a4d70863c1df111a27523"
dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
 from {username='slave'} at 127.0.0.1:60970
I20260709 12:24:48.613423  4008 raft_consensus.cc:493] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:48.613821  4008 raft_consensus.cc:3060] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.625833  4008 raft_consensus.cc:515] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.626541  4221 consensus_queue.cc:1048] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:48.628036  4008 leader_election.cc:290] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 2 election: Requested vote from peers a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:24:48.629069  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b46cfb77a4d70863c1df111a27523" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:24:48.629643  4158 raft_consensus.cc:3060] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.630707  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b46cfb77a4d70863c1df111a27523" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
I20260709 12:24:48.631578  4084 raft_consensus.cc:3055] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:48.631929  4084 raft_consensus.cc:740] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:24:48.632740  4084 consensus_queue.cc:260] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.633961  4084 raft_consensus.cc:3060] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.637463  4158 raft_consensus.cc:2468] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 2.
I20260709 12:24:48.638640  3972 leader_election.cc:304] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624; no voters: 
I20260709 12:24:48.639385  4265 raft_consensus.cc:2804] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:48.639832  4265 raft_consensus.cc:697] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 LEADER]: Becoming Leader. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Running, Role: LEADER
I20260709 12:24:48.640686  4265 consensus_queue.cc:237] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:48.645159  4084 raft_consensus.cc:2468] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 2.
I20260709 12:24:48.647593  3904 catalog_manager.cc:5697] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 reported cstate change: term changed from 1 to 2, leader changed from a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66) to 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65). New cstate: current_term: 2 leader_uuid: "1b10efe7f4e34d9d84606f74160c6624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:48.800455  4008 raft_consensus.cc:1275] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Refusing update from remote peer a4d2a27c4d354c05b90ef41591eceb9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:48.801944  4240 consensus_queue.cc:1048] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:48.814465  4158 raft_consensus.cc:1275] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Refusing update from remote peer a4d2a27c4d354c05b90ef41591eceb9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:48.816135  4243 consensus_queue.cc:1048] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:48.827446  4008 raft_consensus.cc:1275] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Refusing update from remote peer a4d2a27c4d354c05b90ef41591eceb9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:48.830454  4240 consensus_queue.cc:1048] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:48.846835  4158 raft_consensus.cc:1275] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Refusing update from remote peer a4d2a27c4d354c05b90ef41591eceb9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:48.848436  4238 consensus_queue.cc:1048] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:48.901636  4158 raft_consensus.cc:1275] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Refusing update from remote peer a4d2a27c4d354c05b90ef41591eceb9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:48.903752  4008 raft_consensus.cc:1275] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Refusing update from remote peer a4d2a27c4d354c05b90ef41591eceb9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:48.903367  4238 consensus_queue.cc:1048] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:48.905335  4290 consensus_queue.cc:1048] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:48.951172  4158 raft_consensus.cc:1275] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Refusing update from remote peer 1b10efe7f4e34d9d84606f74160c6624: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:48.952437  4265 consensus_queue.cc:1048] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:48.962333  4083 raft_consensus.cc:1275] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Refusing update from remote peer 1b10efe7f4e34d9d84606f74160c6624: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:48.963667  4265 consensus_queue.cc:1048] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:49.180290  4083 raft_consensus.cc:1275] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Refusing update from remote peer 1b10efe7f4e34d9d84606f74160c6624: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:49.181603  4265 consensus_queue.cc:1048] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:49.189862  4158 raft_consensus.cc:1275] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Refusing update from remote peer 1b10efe7f4e34d9d84606f74160c6624: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:49.191278  4206 consensus_queue.cc:1048] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:49.225070  4158 raft_consensus.cc:1275] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Refusing update from remote peer 1b10efe7f4e34d9d84606f74160c6624: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:49.226317  4206 consensus_queue.cc:1048] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:49.235585  4083 raft_consensus.cc:1275] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Refusing update from remote peer 1b10efe7f4e34d9d84606f74160c6624: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:49.237171  4237 consensus_queue.cc:1048] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:51.370577  3873 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:24:51.371280  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:51.392943  4008 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7183afdd01454a648af43ec00011d369"
dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
mode: GRACEFUL
new_leader_uuid: "04d87c7382a4441da74afbdaee7db6f8"
 from {username='slave'} at 127.0.0.1:60986
I20260709 12:24:51.393540  4008 raft_consensus.cc:606] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 LEADER]: Received request to transfer leadership to TS 04d87c7382a4441da74afbdaee7db6f8
I20260709 12:24:51.403935  4083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db3bdead2b554329a75fc42e9c661425"
dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
mode: GRACEFUL
new_leader_uuid: "04d87c7382a4441da74afbdaee7db6f8"
 from {username='slave'} at 127.0.0.1:59754
I20260709 12:24:51.404461  4083 raft_consensus.cc:606] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 LEADER]: Received request to transfer leadership to TS 04d87c7382a4441da74afbdaee7db6f8
I20260709 12:24:51.405786  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:51.406303  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:51.507025  4301 raft_consensus.cc:993] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624: : Instructing follower 04d87c7382a4441da74afbdaee7db6f8 to start an election
I20260709 12:24:51.507537  4301 raft_consensus.cc:1081] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 LEADER]: Signalling peer 04d87c7382a4441da74afbdaee7db6f8 to start an election
I20260709 12:24:51.509084  4157 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7183afdd01454a648af43ec00011d369"
dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
 from {username='slave'} at 127.0.0.1:49914
I20260709 12:24:51.509725  4157 raft_consensus.cc:493] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:51.510083  4157 raft_consensus.cc:3060] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:51.515518  4157 raft_consensus.cc:515] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:51.517581  4157 leader_election.cc:290] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 3 election: Requested vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915)
I20260709 12:24:51.518478  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7183afdd01454a648af43ec00011d369" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
I20260709 12:24:51.518663  4083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7183afdd01454a648af43ec00011d369" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
I20260709 12:24:51.519053  4008 raft_consensus.cc:3055] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:51.519294  4083 raft_consensus.cc:3060] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:51.519496  4008 raft_consensus.cc:740] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Running, Role: LEADER
I20260709 12:24:51.520499  4008 consensus_queue.cc:260] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:51.521664  4008 raft_consensus.cc:3060] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:51.525708  4083 raft_consensus.cc:2468] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04d87c7382a4441da74afbdaee7db6f8 in term 3.
I20260709 12:24:51.526968  4122 leader_election.cc:304] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, a4d2a27c4d354c05b90ef41591eceb9c; no voters: 
I20260709 12:24:51.527055  4008 raft_consensus.cc:2468] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04d87c7382a4441da74afbdaee7db6f8 in term 3.
I20260709 12:24:51.527729  4221 raft_consensus.cc:2804] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:51.529021  4221 raft_consensus.cc:697] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 LEADER]: Becoming Leader. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Running, Role: LEADER
I20260709 12:24:51.529875  4221 consensus_queue.cc:237] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:51.538534  3902 catalog_manager.cc:5697] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 reported cstate change: term changed from 2 to 3, leader changed from 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65) to 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67). New cstate: current_term: 3 leader_uuid: "04d87c7382a4441da74afbdaee7db6f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:51.685215  4296 raft_consensus.cc:993] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c: : Instructing follower 04d87c7382a4441da74afbdaee7db6f8 to start an election
I20260709 12:24:51.685626  4308 raft_consensus.cc:1081] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 LEADER]: Signalling peer 04d87c7382a4441da74afbdaee7db6f8 to start an election
I20260709 12:24:51.687080  4157 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db3bdead2b554329a75fc42e9c661425"
dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
 from {username='slave'} at 127.0.0.1:49906
I20260709 12:24:51.687501  4157 raft_consensus.cc:493] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:51.687793  4157 raft_consensus.cc:3060] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.692804  4157 raft_consensus.cc:515] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:51.694512  4157 leader_election.cc:290] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 2 election: Requested vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915)
I20260709 12:24:51.695196  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db3bdead2b554329a75fc42e9c661425" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
I20260709 12:24:51.695571  4083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db3bdead2b554329a75fc42e9c661425" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
I20260709 12:24:51.695815  4008 raft_consensus.cc:3060] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.696118  4083 raft_consensus.cc:3055] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:51.696400  4083 raft_consensus.cc:740] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:24:51.697062  4083 consensus_queue.cc:260] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:51.697962  4083 raft_consensus.cc:3060] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.700853  4008 raft_consensus.cc:2468] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04d87c7382a4441da74afbdaee7db6f8 in term 2.
I20260709 12:24:51.701851  4121 leader_election.cc:304] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624; no voters: 
I20260709 12:24:51.702498  4083 raft_consensus.cc:2468] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04d87c7382a4441da74afbdaee7db6f8 in term 2.
I20260709 12:24:51.702666  4221 raft_consensus.cc:2804] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:51.703240  4221 raft_consensus.cc:697] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 LEADER]: Becoming Leader. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Running, Role: LEADER
I20260709 12:24:51.703951  4221 consensus_queue.cc:237] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:24:51.710511  3902 catalog_manager.cc:5697] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 reported cstate change: term changed from 1 to 2, leader changed from a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66) to 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67). New cstate: current_term: 2 leader_uuid: "04d87c7382a4441da74afbdaee7db6f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.065042  4083 raft_consensus.cc:1275] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Refusing update from remote peer 04d87c7382a4441da74afbdaee7db6f8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:52.066207  4221 consensus_queue.cc:1048] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:52.075675  4008 raft_consensus.cc:1275] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Refusing update from remote peer 04d87c7382a4441da74afbdaee7db6f8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:52.077251  4221 consensus_queue.cc:1048] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:52.153780  4008 raft_consensus.cc:1275] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Refusing update from remote peer 04d87c7382a4441da74afbdaee7db6f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:52.155092  4221 consensus_queue.cc:1048] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:52.164049  4083 raft_consensus.cc:1275] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Refusing update from remote peer 04d87c7382a4441da74afbdaee7db6f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:52.165757  4221 consensus_queue.cc:1048] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:52.407303  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:52.412220  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:52.412657  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:53.413651  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:53.419385  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:53.419971  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:54.421536  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:54.427750  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:54.428277  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:55.481401  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:55.493350  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:55.493882  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:24:56.481671  3936 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 3876
W20260709 12:24:56.482658  3936 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 3939
W20260709 12:24:56.483551  3936 debug-util.cc:398] Leaking SignalData structure 0x7b08000ed9e0 after lost signal to thread 4033
W20260709 12:24:56.484302  3936 debug-util.cc:398] Leaking SignalData structure 0x7b0800108c60 after lost signal to thread 4108
W20260709 12:24:56.485088  3936 debug-util.cc:398] Leaking SignalData structure 0x7b0800117c60 after lost signal to thread 4182
I20260709 12:24:56.494891  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:56.501120  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:56.501647  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:57.502511  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:57.507380  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:57.507781  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:58.508752  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:58.514497  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:58.514916  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:59.515771  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:59.521008  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:59.521497  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:00.522563  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:00.527773  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:00.528209  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:01.557150  3873 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:25:01.561553  4007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8fedb0755e4ee086e2a983e5b8e4b3"
dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
mode: GRACEFUL
new_leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
 from {username='slave'} at 127.0.0.1:60976
I20260709 12:25:01.562191  4007 raft_consensus.cc:606] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 LEADER]: Received request to transfer leadership to TS a4d2a27c4d354c05b90ef41591eceb9c
I20260709 12:25:01.567346  4007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80c25035ddbd458b810ee7ad5b3e4855"
dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
mode: GRACEFUL
new_leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
 from {username='slave'} at 127.0.0.1:60976
I20260709 12:25:01.567816  4007 raft_consensus.cc:606] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 LEADER]: Received request to transfer leadership to TS a4d2a27c4d354c05b90ef41591eceb9c
I20260709 12:25:01.572633  4156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7183afdd01454a648af43ec00011d369"
dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
mode: GRACEFUL
new_leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
 from {username='slave'} at 127.0.0.1:49930
I20260709 12:25:01.573144  4156 raft_consensus.cc:606] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 LEADER]: Received request to transfer leadership to TS a4d2a27c4d354c05b90ef41591eceb9c
I20260709 12:25:01.577963  4007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c1b46cfb77a4d70863c1df111a27523"
dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
mode: GRACEFUL
new_leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
 from {username='slave'} at 127.0.0.1:60976
I20260709 12:25:01.578414  4007 raft_consensus.cc:606] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 LEADER]: Received request to transfer leadership to TS a4d2a27c4d354c05b90ef41591eceb9c
I20260709 12:25:01.587769  4156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db3bdead2b554329a75fc42e9c661425"
dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
mode: GRACEFUL
new_leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
 from {username='slave'} at 127.0.0.1:49930
I20260709 12:25:01.588296  4156 raft_consensus.cc:606] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 LEADER]: Received request to transfer leadership to TS a4d2a27c4d354c05b90ef41591eceb9c
I20260709 12:25:01.601589  4331 raft_consensus.cc:993] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624: : Instructing follower a4d2a27c4d354c05b90ef41591eceb9c to start an election
I20260709 12:25:01.602169  4324 raft_consensus.cc:1081] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 LEADER]: Signalling peer a4d2a27c4d354c05b90ef41591eceb9c to start an election
I20260709 12:25:01.603721  4084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a8fedb0755e4ee086e2a983e5b8e4b3"
dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
 from {username='slave'} at 127.0.0.1:59740
I20260709 12:25:01.604202  4084 raft_consensus.cc:493] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:01.604519  4084 raft_consensus.cc:3060] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.612488  4084 raft_consensus.cc:515] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } }
I20260709 12:25:01.614694  4084 leader_election.cc:290] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 2 election: Requested vote from peers 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475), 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853)
I20260709 12:25:01.616413  4156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8fedb0755e4ee086e2a983e5b8e4b3" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:25:01.616387  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8fedb0755e4ee086e2a983e5b8e4b3" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
I20260709 12:25:01.617238  4156 raft_consensus.cc:3060] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.617280  4007 raft_consensus.cc:3055] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:01.617705  4007 raft_consensus.cc:740] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Running, Role: LEADER
I20260709 12:25:01.618441  4007 consensus_queue.cc:260] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } }
I20260709 12:25:01.619390  4007 raft_consensus.cc:3060] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.622583  4156 raft_consensus.cc:2468] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 2.
I20260709 12:25:01.623943  4048 leader_election.cc:304] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, a4d2a27c4d354c05b90ef41591eceb9c; no voters: 
I20260709 12:25:01.624110  4007 raft_consensus.cc:2468] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 2.
I20260709 12:25:01.625031  4323 raft_consensus.cc:2804] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:01.626368  4323 raft_consensus.cc:697] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 LEADER]: Becoming Leader. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:25:01.627408  4323 consensus_queue.cc:237] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } }
I20260709 12:25:01.637012  3903 catalog_manager.cc:5697] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c reported cstate change: term changed from 1 to 2, leader changed from 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65) to a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66). New cstate: current_term: 2 leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.691154  4319 raft_consensus.cc:993] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8: : Instructing follower a4d2a27c4d354c05b90ef41591eceb9c to start an election
I20260709 12:25:01.691717  4338 raft_consensus.cc:1081] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 LEADER]: Signalling peer a4d2a27c4d354c05b90ef41591eceb9c to start an election
I20260709 12:25:01.693643  4084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db3bdead2b554329a75fc42e9c661425"
dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
 from {username='slave'} at 127.0.0.1:59738
I20260709 12:25:01.694075  4084 raft_consensus.cc:493] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:01.694418  4084 raft_consensus.cc:3060] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.698344  4084 raft_consensus.cc:515] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:01.699654  4084 leader_election.cc:290] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 3 election: Requested vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:25:01.700510  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db3bdead2b554329a75fc42e9c661425" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
I20260709 12:25:01.700716  4156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db3bdead2b554329a75fc42e9c661425" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:25:01.701088  4007 raft_consensus.cc:3060] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.701270  4156 raft_consensus.cc:3055] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:01.701696  4156 raft_consensus.cc:740] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Running, Role: LEADER
I20260709 12:25:01.702406  4156 consensus_queue.cc:260] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:01.703478  4156 raft_consensus.cc:3060] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.705422  4007 raft_consensus.cc:2468] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 3.
I20260709 12:25:01.706449  4047 leader_election.cc:304] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b10efe7f4e34d9d84606f74160c6624, a4d2a27c4d354c05b90ef41591eceb9c; no voters: 
I20260709 12:25:01.707053  4323 raft_consensus.cc:2804] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:01.707461  4323 raft_consensus.cc:697] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 LEADER]: Becoming Leader. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:25:01.708231  4323 consensus_queue.cc:237] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:01.708634  4156 raft_consensus.cc:2468] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 3.
I20260709 12:25:01.715072  3903 catalog_manager.cc:5697] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c reported cstate change: term changed from 2 to 3, leader changed from 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67) to a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66). New cstate: current_term: 3 leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.825325  4331 raft_consensus.cc:993] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624: : Instructing follower a4d2a27c4d354c05b90ef41591eceb9c to start an election
I20260709 12:25:01.825806  4324 raft_consensus.cc:1081] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 LEADER]: Signalling peer a4d2a27c4d354c05b90ef41591eceb9c to start an election
I20260709 12:25:01.827243  4084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80c25035ddbd458b810ee7ad5b3e4855"
dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
 from {username='slave'} at 127.0.0.1:59740
I20260709 12:25:01.827733  4084 raft_consensus.cc:493] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:01.828080  4084 raft_consensus.cc:3060] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.832489  4084 raft_consensus.cc:515] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:01.833784  4084 leader_election.cc:290] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 3 election: Requested vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:25:01.834537  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c25035ddbd458b810ee7ad5b3e4855" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
I20260709 12:25:01.834759  4156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c25035ddbd458b810ee7ad5b3e4855" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:25:01.835151  4007 raft_consensus.cc:3055] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:01.835254  4156 raft_consensus.cc:3060] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.835479  4007 raft_consensus.cc:740] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Running, Role: LEADER
I20260709 12:25:01.836241  4007 consensus_queue.cc:260] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:01.837384  4007 raft_consensus.cc:3060] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.842036  4156 raft_consensus.cc:2468] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 3.
I20260709 12:25:01.843284  4048 leader_election.cc:304] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, a4d2a27c4d354c05b90ef41591eceb9c; no voters: 
I20260709 12:25:01.843498  4007 raft_consensus.cc:2468] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 3.
I20260709 12:25:01.844048  4323 raft_consensus.cc:2804] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:01.844766  4323 raft_consensus.cc:697] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 LEADER]: Becoming Leader. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:25:01.845412  4323 consensus_queue.cc:237] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:01.852209  3903 catalog_manager.cc:5697] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c reported cstate change: term changed from 2 to 3, leader changed from 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65) to a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66). New cstate: current_term: 3 leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.867143  4319 raft_consensus.cc:993] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8: : Instructing follower a4d2a27c4d354c05b90ef41591eceb9c to start an election
I20260709 12:25:01.867586  4319 raft_consensus.cc:1081] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 LEADER]: Signalling peer a4d2a27c4d354c05b90ef41591eceb9c to start an election
I20260709 12:25:01.869030  4084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7183afdd01454a648af43ec00011d369"
dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
 from {username='slave'} at 127.0.0.1:59738
I20260709 12:25:01.869474  4084 raft_consensus.cc:493] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:01.869753  4084 raft_consensus.cc:3060] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:01.873561  4084 raft_consensus.cc:515] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:01.874929  4084 leader_election.cc:290] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 4 election: Requested vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:25:01.875710  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7183afdd01454a648af43ec00011d369" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
I20260709 12:25:01.875959  4156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7183afdd01454a648af43ec00011d369" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:25:01.876320  4007 raft_consensus.cc:3060] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:01.876531  4156 raft_consensus.cc:3055] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:01.876933  4156 raft_consensus.cc:740] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Running, Role: LEADER
I20260709 12:25:01.877807  4156 consensus_queue.cc:260] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:01.879014  4156 raft_consensus.cc:3060] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:01.882651  4007 raft_consensus.cc:2468] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 4.
I20260709 12:25:01.883764  4047 leader_election.cc:304] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b10efe7f4e34d9d84606f74160c6624, a4d2a27c4d354c05b90ef41591eceb9c; no voters: 
I20260709 12:25:01.884436  4323 raft_consensus.cc:2804] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:01.884940  4323 raft_consensus.cc:697] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 4 LEADER]: Becoming Leader. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:25:01.885345  4156 raft_consensus.cc:2468] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 4.
I20260709 12:25:01.885762  4323 consensus_queue.cc:237] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:01.892432  3903 catalog_manager.cc:5697] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c reported cstate change: term changed from 3 to 4, leader changed from 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67) to a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66). New cstate: current_term: 4 leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.959357  4331 raft_consensus.cc:993] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624: : Instructing follower a4d2a27c4d354c05b90ef41591eceb9c to start an election
I20260709 12:25:01.959801  4331 raft_consensus.cc:1081] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 LEADER]: Signalling peer a4d2a27c4d354c05b90ef41591eceb9c to start an election
I20260709 12:25:01.961282  4084 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c1b46cfb77a4d70863c1df111a27523"
dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
 from {username='slave'} at 127.0.0.1:59740
I20260709 12:25:01.961793  4084 raft_consensus.cc:493] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:01.962190  4084 raft_consensus.cc:3060] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.967339  4084 raft_consensus.cc:515] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:01.969024  4084 leader_election.cc:290] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 3 election: Requested vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:25:01.969964  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b46cfb77a4d70863c1df111a27523" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
I20260709 12:25:01.970060  4156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c1b46cfb77a4d70863c1df111a27523" candidate_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:25:01.970623  4007 raft_consensus.cc:3055] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:01.970706  4156 raft_consensus.cc:3060] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.970928  4007 raft_consensus.cc:740] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Running, Role: LEADER
I20260709 12:25:01.971714  4007 consensus_queue.cc:260] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:01.972636  4007 raft_consensus.cc:3060] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.975991  4156 raft_consensus.cc:2468] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 3.
I20260709 12:25:01.976897  4007 raft_consensus.cc:2468] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4d2a27c4d354c05b90ef41591eceb9c in term 3.
I20260709 12:25:01.977089  4048 leader_election.cc:304] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, a4d2a27c4d354c05b90ef41591eceb9c; no voters: 
I20260709 12:25:01.978080  4323 raft_consensus.cc:2804] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:01.978569  4323 raft_consensus.cc:697] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 LEADER]: Becoming Leader. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:25:01.979322  4323 consensus_queue.cc:237] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:01.986466  3903 catalog_manager.cc:5697] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c reported cstate change: term changed from 2 to 3, leader changed from 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65) to a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66). New cstate: current_term: 3 leader_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:02.111725  4007 raft_consensus.cc:1275] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Refusing update from remote peer a4d2a27c4d354c05b90ef41591eceb9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:02.113161  4323 consensus_queue.cc:1048] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:02.124900  4156 raft_consensus.cc:1275] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Refusing update from remote peer a4d2a27c4d354c05b90ef41591eceb9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:02.126904  4345 consensus_queue.cc:1048] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:02.165678  4156 raft_consensus.cc:1275] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Refusing update from remote peer a4d2a27c4d354c05b90ef41591eceb9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:02.167191  4345 consensus_queue.cc:1048] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:02.176821  4007 raft_consensus.cc:1275] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Refusing update from remote peer a4d2a27c4d354c05b90ef41591eceb9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:02.178550  4345 consensus_queue.cc:1048] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:02.272109  4156 raft_consensus.cc:1275] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Refusing update from remote peer a4d2a27c4d354c05b90ef41591eceb9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:02.273443  4345 consensus_queue.cc:1048] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:02.282289  4007 raft_consensus.cc:1275] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Refusing update from remote peer a4d2a27c4d354c05b90ef41591eceb9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:02.284430  4332 consensus_queue.cc:1048] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:02.351496  4156 raft_consensus.cc:1275] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 4 FOLLOWER]: Refusing update from remote peer a4d2a27c4d354c05b90ef41591eceb9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:02.352882  4323 consensus_queue.cc:1048] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:02.361956  4007 raft_consensus.cc:1275] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 4 FOLLOWER]: Refusing update from remote peer a4d2a27c4d354c05b90ef41591eceb9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:02.363533  4332 consensus_queue.cc:1048] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:02.548427  4007 raft_consensus.cc:1275] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Refusing update from remote peer a4d2a27c4d354c05b90ef41591eceb9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:02.549649  4332 consensus_queue.cc:1048] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:02.559543  4156 raft_consensus.cc:1275] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Refusing update from remote peer a4d2a27c4d354c05b90ef41591eceb9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:02.561013  4323 consensus_queue.cc:1048] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:04.624778  3873 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:25:04.625624  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:04.632828  4084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d1b4e857aff48e296a9a69c27a84ac2"
dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
mode: GRACEFUL
new_leader_uuid: "1b10efe7f4e34d9d84606f74160c6624"
 from {username='slave'} at 127.0.0.1:59754
I20260709 12:25:04.633458  4084 raft_consensus.cc:606] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 LEADER]: Received request to transfer leadership to TS 1b10efe7f4e34d9d84606f74160c6624
I20260709 12:25:04.635967  4084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7183afdd01454a648af43ec00011d369"
dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
mode: GRACEFUL
new_leader_uuid: "1b10efe7f4e34d9d84606f74160c6624"
 from {username='slave'} at 127.0.0.1:59754
I20260709 12:25:04.636436  4084 raft_consensus.cc:606] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 4 LEADER]: Received request to transfer leadership to TS 1b10efe7f4e34d9d84606f74160c6624
I20260709 12:25:04.638839  4084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80c25035ddbd458b810ee7ad5b3e4855"
dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
mode: GRACEFUL
new_leader_uuid: "04d87c7382a4441da74afbdaee7db6f8"
 from {username='slave'} at 127.0.0.1:59754
I20260709 12:25:04.639214  4084 raft_consensus.cc:606] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 LEADER]: Received request to transfer leadership to TS 04d87c7382a4441da74afbdaee7db6f8
I20260709 12:25:04.641399  4084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8fedb0755e4ee086e2a983e5b8e4b3"
dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
mode: GRACEFUL
new_leader_uuid: "1b10efe7f4e34d9d84606f74160c6624"
 from {username='slave'} at 127.0.0.1:59754
I20260709 12:25:04.641847  4084 raft_consensus.cc:606] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 LEADER]: Received request to transfer leadership to TS 1b10efe7f4e34d9d84606f74160c6624
I20260709 12:25:04.644300  4084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db3bdead2b554329a75fc42e9c661425"
dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
mode: GRACEFUL
new_leader_uuid: "04d87c7382a4441da74afbdaee7db6f8"
 from {username='slave'} at 127.0.0.1:59754
I20260709 12:25:04.644846  4084 raft_consensus.cc:606] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 LEADER]: Received request to transfer leadership to TS 04d87c7382a4441da74afbdaee7db6f8
I20260709 12:25:04.645876  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:04.646291  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:04.686184  4323 raft_consensus.cc:993] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c: : Instructing follower 04d87c7382a4441da74afbdaee7db6f8 to start an election
I20260709 12:25:04.686654  4323 raft_consensus.cc:1081] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 LEADER]: Signalling peer 04d87c7382a4441da74afbdaee7db6f8 to start an election
I20260709 12:25:04.688285  4156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80c25035ddbd458b810ee7ad5b3e4855"
dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
 from {username='slave'} at 127.0.0.1:49906
I20260709 12:25:04.688761  4156 raft_consensus.cc:493] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:04.689028  4156 raft_consensus.cc:3060] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:04.693995  4156 raft_consensus.cc:515] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:04.696069  4156 leader_election.cc:290] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 4 election: Requested vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915)
I20260709 12:25:04.697217  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c25035ddbd458b810ee7ad5b3e4855" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
I20260709 12:25:04.697319  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80c25035ddbd458b810ee7ad5b3e4855" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
I20260709 12:25:04.698163  4084 raft_consensus.cc:3055] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:04.698240  4008 raft_consensus.cc:3060] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:04.698555  4084 raft_consensus.cc:740] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:25:04.699420  4084 consensus_queue.cc:260] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:04.700856  4084 raft_consensus.cc:3060] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:04.705047  4008 raft_consensus.cc:2468] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04d87c7382a4441da74afbdaee7db6f8 in term 4.
I20260709 12:25:04.706456  4121 leader_election.cc:304] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624; no voters: 
I20260709 12:25:04.707490  4084 raft_consensus.cc:2468] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04d87c7382a4441da74afbdaee7db6f8 in term 4.
I20260709 12:25:04.707531  4319 raft_consensus.cc:2804] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:04.708876  4319 raft_consensus.cc:697] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 4 LEADER]: Becoming Leader. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Running, Role: LEADER
I20260709 12:25:04.709717  4319 consensus_queue.cc:237] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:04.716732  3903 catalog_manager.cc:5697] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 reported cstate change: term changed from 3 to 4, leader changed from a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66) to 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67). New cstate: current_term: 4 leader_uuid: "04d87c7382a4441da74afbdaee7db6f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:04.721065  4360 raft_consensus.cc:993] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c: : Instructing follower 1b10efe7f4e34d9d84606f74160c6624 to start an election
I20260709 12:25:04.721539  4323 raft_consensus.cc:1081] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 LEADER]: Signalling peer 1b10efe7f4e34d9d84606f74160c6624 to start an election
I20260709 12:25:04.723088  4008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a8fedb0755e4ee086e2a983e5b8e4b3"
dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
 from {username='slave'} at 127.0.0.1:60970
I20260709 12:25:04.723613  4008 raft_consensus.cc:493] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:04.723925  4008 raft_consensus.cc:3060] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:04.731238  4008 raft_consensus.cc:515] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } }
I20260709 12:25:04.733626  4008 leader_election.cc:290] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 3 election: Requested vote from peers 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475), a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915)
I20260709 12:25:04.734699  4156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8fedb0755e4ee086e2a983e5b8e4b3" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:25:04.734967  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8fedb0755e4ee086e2a983e5b8e4b3" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
I20260709 12:25:04.735270  4156 raft_consensus.cc:3060] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:04.735450  4084 raft_consensus.cc:3055] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:04.735776  4084 raft_consensus.cc:740] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:25:04.736500  4084 consensus_queue.cc:260] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } }
I20260709 12:25:04.737730  4084 raft_consensus.cc:3060] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:04.741559  4156 raft_consensus.cc:2468] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 3.
I20260709 12:25:04.742821  3972 leader_election.cc:304] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624; no voters: 
I20260709 12:25:04.743863  4084 raft_consensus.cc:2468] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 3.
I20260709 12:25:04.744647  4367 raft_consensus.cc:2804] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:04.745833  4367 raft_consensus.cc:697] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 LEADER]: Becoming Leader. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Running, Role: LEADER
I20260709 12:25:04.746690  4367 consensus_queue.cc:237] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } }
I20260709 12:25:04.753211  3903 catalog_manager.cc:5697] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 reported cstate change: term changed from 2 to 3, leader changed from a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66) to 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65). New cstate: current_term: 3 leader_uuid: "1b10efe7f4e34d9d84606f74160c6624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:04.768474  4360 raft_consensus.cc:993] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c: : Instructing follower 1b10efe7f4e34d9d84606f74160c6624 to start an election
I20260709 12:25:04.769093  4323 raft_consensus.cc:1081] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 LEADER]: Signalling peer 1b10efe7f4e34d9d84606f74160c6624 to start an election
I20260709 12:25:04.770628  4008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d1b4e857aff48e296a9a69c27a84ac2"
dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
 from {username='slave'} at 127.0.0.1:60970
I20260709 12:25:04.771113  4008 raft_consensus.cc:493] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:04.771410  4008 raft_consensus.cc:3060] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:04.775761  4008 raft_consensus.cc:515] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:04.777447  4008 leader_election.cc:290] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 3 election: Requested vote from peers a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:25:04.778422  4156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1b4e857aff48e296a9a69c27a84ac2" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:25:04.778344  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d1b4e857aff48e296a9a69c27a84ac2" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
I20260709 12:25:04.779070  4156 raft_consensus.cc:3060] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:04.779121  4084 raft_consensus.cc:3055] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:04.779501  4084 raft_consensus.cc:740] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:25:04.780226  4084 consensus_queue.cc:260] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:04.781108  4084 raft_consensus.cc:3060] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:04.783587  4156 raft_consensus.cc:2468] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 3.
I20260709 12:25:04.784507  3972 leader_election.cc:304] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624; no voters: 
I20260709 12:25:04.785308  4367 raft_consensus.cc:2804] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:04.785447  4084 raft_consensus.cc:2468] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 3.
I20260709 12:25:04.785825  4367 raft_consensus.cc:697] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 LEADER]: Becoming Leader. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Running, Role: LEADER
I20260709 12:25:04.786675  4367 consensus_queue.cc:237] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:04.793045  3903 catalog_manager.cc:5697] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 reported cstate change: term changed from 2 to 3, leader changed from a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66) to 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65). New cstate: current_term: 3 leader_uuid: "1b10efe7f4e34d9d84606f74160c6624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:04.816059  4360 raft_consensus.cc:993] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c: : Instructing follower 1b10efe7f4e34d9d84606f74160c6624 to start an election
I20260709 12:25:04.816509  4360 raft_consensus.cc:1081] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 4 LEADER]: Signalling peer 1b10efe7f4e34d9d84606f74160c6624 to start an election
I20260709 12:25:04.818284  4008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7183afdd01454a648af43ec00011d369"
dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
 from {username='slave'} at 127.0.0.1:60970
I20260709 12:25:04.818822  4008 raft_consensus.cc:493] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:04.819043  4008 raft_consensus.cc:3060] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:04.823035  4008 raft_consensus.cc:515] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:04.824754  4008 leader_election.cc:290] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 5 election: Requested vote from peers a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915), 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67:33475)
I20260709 12:25:04.826215  4158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7183afdd01454a648af43ec00011d369" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
I20260709 12:25:04.826576  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7183afdd01454a648af43ec00011d369" candidate_uuid: "1b10efe7f4e34d9d84606f74160c6624" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
I20260709 12:25:04.826841  4158 raft_consensus.cc:3060] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:04.827097  4084 raft_consensus.cc:3055] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:04.827435  4084 raft_consensus.cc:740] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:25:04.828199  4360 raft_consensus.cc:993] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c: : Instructing follower 04d87c7382a4441da74afbdaee7db6f8 to start an election
I20260709 12:25:04.828735  4360 raft_consensus.cc:1081] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 LEADER]: Signalling peer 04d87c7382a4441da74afbdaee7db6f8 to start an election
I20260709 12:25:04.828274  4084 consensus_queue.cc:260] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:04.830062  4084 raft_consensus.cc:3060] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:04.830375  4156 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db3bdead2b554329a75fc42e9c661425"
dest_uuid: "04d87c7382a4441da74afbdaee7db6f8"
 from {username='slave'} at 127.0.0.1:49906
I20260709 12:25:04.830909  4156 raft_consensus.cc:493] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:04.831238  4156 raft_consensus.cc:3060] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:04.833379  4158 raft_consensus.cc:2468] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 5.
I20260709 12:25:04.834365  3972 leader_election.cc:304] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624; no voters: 
I20260709 12:25:04.835175  4367 raft_consensus.cc:2804] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:04.835619  4367 raft_consensus.cc:697] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 5 LEADER]: Becoming Leader. State: Replica: 1b10efe7f4e34d9d84606f74160c6624, State: Running, Role: LEADER
I20260709 12:25:04.836148  4084 raft_consensus.cc:2468] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b10efe7f4e34d9d84606f74160c6624 in term 5.
I20260709 12:25:04.836409  4367 consensus_queue.cc:237] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:04.837227  4156 raft_consensus.cc:515] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:04.839497  4156 leader_election.cc:290] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 4 election: Requested vote from peers 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853), a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66:45915)
I20260709 12:25:04.839543  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db3bdead2b554329a75fc42e9c661425" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1b10efe7f4e34d9d84606f74160c6624"
I20260709 12:25:04.840207  4008 raft_consensus.cc:3060] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:04.840833  4084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db3bdead2b554329a75fc42e9c661425" candidate_uuid: "04d87c7382a4441da74afbdaee7db6f8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a4d2a27c4d354c05b90ef41591eceb9c"
I20260709 12:25:04.841368  4084 raft_consensus.cc:3055] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:04.841922  4084 raft_consensus.cc:740] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a4d2a27c4d354c05b90ef41591eceb9c, State: Running, Role: LEADER
I20260709 12:25:04.842896  4084 consensus_queue.cc:260] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:04.843976  4084 raft_consensus.cc:3060] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:04.845777  3903 catalog_manager.cc:5697] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 reported cstate change: term changed from 4 to 5, leader changed from a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66) to 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65). New cstate: current_term: 5 leader_uuid: "1b10efe7f4e34d9d84606f74160c6624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:04.846719  4008 raft_consensus.cc:2468] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04d87c7382a4441da74afbdaee7db6f8 in term 4.
I20260709 12:25:04.847793  4121 leader_election.cc:304] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04d87c7382a4441da74afbdaee7db6f8, 1b10efe7f4e34d9d84606f74160c6624; no voters: 
I20260709 12:25:04.848620  4319 raft_consensus.cc:2804] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:04.849084  4319 raft_consensus.cc:697] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 4 LEADER]: Becoming Leader. State: Replica: 04d87c7382a4441da74afbdaee7db6f8, State: Running, Role: LEADER
I20260709 12:25:04.849960  4084 raft_consensus.cc:2468] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04d87c7382a4441da74afbdaee7db6f8 in term 4.
I20260709 12:25:04.849946  4319 consensus_queue.cc:237] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } }
I20260709 12:25:04.857504  3903 catalog_manager.cc:5697] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 reported cstate change: term changed from 3 to 4, leader changed from a4d2a27c4d354c05b90ef41591eceb9c (127.3.200.66) to 04d87c7382a4441da74afbdaee7db6f8 (127.3.200.67). New cstate: current_term: 4 leader_uuid: "04d87c7382a4441da74afbdaee7db6f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:05.109213  4008 raft_consensus.cc:1275] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 4 FOLLOWER]: Refusing update from remote peer 04d87c7382a4441da74afbdaee7db6f8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:05.110500  4319 consensus_queue.cc:1048] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:05.122838  4084 raft_consensus.cc:1275] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 4 FOLLOWER]: Refusing update from remote peer 04d87c7382a4441da74afbdaee7db6f8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:05.125173  4361 consensus_queue.cc:1048] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:05.239601  4008 raft_consensus.cc:1275] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624 [term 4 FOLLOWER]: Refusing update from remote peer 04d87c7382a4441da74afbdaee7db6f8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:05.240839  4361 consensus_queue.cc:1048] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b10efe7f4e34d9d84606f74160c6624" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:05.250243  4082 raft_consensus.cc:1275] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 4 FOLLOWER]: Refusing update from remote peer 04d87c7382a4441da74afbdaee7db6f8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:05.251730  4361 consensus_queue.cc:1048] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:05.285386  4082 raft_consensus.cc:1275] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 5 FOLLOWER]: Refusing update from remote peer 1b10efe7f4e34d9d84606f74160c6624: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:05.286965  4367 consensus_queue.cc:1048] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:05.294400  4156 raft_consensus.cc:1275] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 5 FOLLOWER]: Refusing update from remote peer 1b10efe7f4e34d9d84606f74160c6624: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:05.296721  4368 consensus_queue.cc:1048] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:05.323328  4156 raft_consensus.cc:1275] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Refusing update from remote peer 1b10efe7f4e34d9d84606f74160c6624: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:05.324507  4368 consensus_queue.cc:1048] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:05.334260  4082 raft_consensus.cc:1275] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Refusing update from remote peer 1b10efe7f4e34d9d84606f74160c6624: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:05.335736  4385 consensus_queue.cc:1048] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:05.373034  4156 raft_consensus.cc:1275] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Refusing update from remote peer 1b10efe7f4e34d9d84606f74160c6624: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:05.374274  4385 consensus_queue.cc:1048] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04d87c7382a4441da74afbdaee7db6f8" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 33475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:05.383044  4082 raft_consensus.cc:1275] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Refusing update from remote peer 1b10efe7f4e34d9d84606f74160c6624: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:05.384814  4367 consensus_queue.cc:1048] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4d2a27c4d354c05b90ef41591eceb9c" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 45915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:05.647524  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:05.652519  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:05.652908  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:06.653940  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:06.658604  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:06.659087  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:07.660223  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:07.665809  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:07.666218  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:08.667469  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:08.672299  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:08.672698  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:09.673614  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:09.678867  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:09.679231  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:10.680150  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:10.685030  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:10.685497  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:11.686633  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:11.692153  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:11.692750  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:12.693984  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:12.701304  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:12.701781  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:13.702827  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:13.707866  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:13.708298  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:14.740836  3873 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:25:14.741498  3873 tablet_server.cc:179] TabletServer@127.3.200.65:0 shutting down...
I20260709 12:25:14.769783  3873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:14.770601  3873 tablet_replica.cc:333] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624: stopping tablet replica
I20260709 12:25:14.771394  3873 raft_consensus.cc:2243] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.772095  3873 raft_consensus.cc:2272] T 2c1b46cfb77a4d70863c1df111a27523 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.774556  3873 tablet_replica.cc:333] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624: stopping tablet replica
I20260709 12:25:14.775103  3873 raft_consensus.cc:2243] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.776008  3873 raft_consensus.cc:2272] T 3d1b4e857aff48e296a9a69c27a84ac2 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.777971  3873 tablet_replica.cc:333] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624: stopping tablet replica
I20260709 12:25:14.778481  3873 raft_consensus.cc:2243] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.778887  3873 raft_consensus.cc:2272] T 1502de7867d7495bb2a73420c7190153 P 1b10efe7f4e34d9d84606f74160c6624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.780495  3873 tablet_replica.cc:333] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624: stopping tablet replica
I20260709 12:25:14.781075  3873 raft_consensus.cc:2243] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.781627  3873 raft_consensus.cc:2272] T db3bdead2b554329a75fc42e9c661425 P 1b10efe7f4e34d9d84606f74160c6624 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.783321  3873 tablet_replica.cc:333] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624: stopping tablet replica
I20260709 12:25:14.783936  3873 raft_consensus.cc:2243] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.784663  3873 raft_consensus.cc:2272] T 80c25035ddbd458b810ee7ad5b3e4855 P 1b10efe7f4e34d9d84606f74160c6624 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.786798  3873 tablet_replica.cc:333] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624: stopping tablet replica
I20260709 12:25:14.787227  3873 raft_consensus.cc:2243] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.788190  3873 raft_consensus.cc:2272] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 1b10efe7f4e34d9d84606f74160c6624 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.789907  3873 tablet_replica.cc:333] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624: stopping tablet replica
I20260709 12:25:14.790398  3873 raft_consensus.cc:2243] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.790815  3873 raft_consensus.cc:2272] T d72d31ebf33b4960ac55664142d46f32 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.792333  3873 tablet_replica.cc:333] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624: stopping tablet replica
I20260709 12:25:14.792814  3873 raft_consensus.cc:2243] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.793740  3873 raft_consensus.cc:2272] T 7183afdd01454a648af43ec00011d369 P 1b10efe7f4e34d9d84606f74160c6624 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.795576  3873 tablet_replica.cc:333] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624: stopping tablet replica
I20260709 12:25:14.796003  3873 raft_consensus.cc:2243] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.796463  3873 raft_consensus.cc:2272] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 1b10efe7f4e34d9d84606f74160c6624 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:14.797063  4121 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:14.800462  4121 consensus_peers.cc:597] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 -> Peer 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853): Couldn't send request to peer 1b10efe7f4e34d9d84606f74160c6624. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.884465  3873 tablet_server.cc:196] TabletServer@127.3.200.65:0 shutdown complete.
I20260709 12:25:14.906299  3873 tablet_server.cc:179] TabletServer@127.3.200.66:0 shutting down...
I20260709 12:25:14.934674  3873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:14.935483  3873 tablet_replica.cc:333] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c: stopping tablet replica
I20260709 12:25:14.936795  3873 raft_consensus.cc:2243] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.937582  3873 raft_consensus.cc:2272] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:14.939767  4047 consensus_peers.cc:597] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c -> Peer 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853): Couldn't send request to peer 1b10efe7f4e34d9d84606f74160c6624. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:36853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.940107  3873 tablet_replica.cc:333] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c: stopping tablet replica
I20260709 12:25:14.940758  3873 raft_consensus.cc:2243] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.941227  3873 raft_consensus.cc:2272] T 7183afdd01454a648af43ec00011d369 P a4d2a27c4d354c05b90ef41591eceb9c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.942901  3873 tablet_replica.cc:333] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c: stopping tablet replica
I20260709 12:25:14.943385  3873 raft_consensus.cc:2243] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.944216  3873 raft_consensus.cc:2272] T d72d31ebf33b4960ac55664142d46f32 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.945906  3873 tablet_replica.cc:333] T 1502de7867d7495bb2a73420c7190153 P a4d2a27c4d354c05b90ef41591eceb9c: stopping tablet replica
I20260709 12:25:14.946396  3873 raft_consensus.cc:2243] T 1502de7867d7495bb2a73420c7190153 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.946805  3873 raft_consensus.cc:2272] T 1502de7867d7495bb2a73420c7190153 P a4d2a27c4d354c05b90ef41591eceb9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.948311  3873 tablet_replica.cc:333] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c: stopping tablet replica
I20260709 12:25:14.948844  3873 raft_consensus.cc:2243] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.949254  3873 raft_consensus.cc:2272] T 3d1b4e857aff48e296a9a69c27a84ac2 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.950966  3873 tablet_replica.cc:333] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c: stopping tablet replica
I20260709 12:25:14.951440  3873 raft_consensus.cc:2243] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.951894  3873 raft_consensus.cc:2272] T 80c25035ddbd458b810ee7ad5b3e4855 P a4d2a27c4d354c05b90ef41591eceb9c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.953627  3873 tablet_replica.cc:333] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c: stopping tablet replica
I20260709 12:25:14.954113  3873 raft_consensus.cc:2243] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.954522  3873 raft_consensus.cc:2272] T db3bdead2b554329a75fc42e9c661425 P a4d2a27c4d354c05b90ef41591eceb9c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.956095  3873 tablet_replica.cc:333] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c: stopping tablet replica
I20260709 12:25:14.956526  3873 raft_consensus.cc:2243] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.957319  3873 raft_consensus.cc:2272] T 9db9913c3c0e4ff4ae3afb2a1446a948 P a4d2a27c4d354c05b90ef41591eceb9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.959137  3873 tablet_replica.cc:333] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c: stopping tablet replica
I20260709 12:25:14.959575  3873 raft_consensus.cc:2243] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.960364  3873 raft_consensus.cc:2272] T 2c1b46cfb77a4d70863c1df111a27523 P a4d2a27c4d354c05b90ef41591eceb9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.989542  3873 tablet_server.cc:196] TabletServer@127.3.200.66:0 shutdown complete.
W20260709 12:25:15.006107  4121 consensus_peers.cc:597] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 -> Peer 1b10efe7f4e34d9d84606f74160c6624 (127.3.200.65:36853): Couldn't send request to peer 1b10efe7f4e34d9d84606f74160c6624. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:36853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:15.012161  3873 tablet_server.cc:179] TabletServer@127.3.200.67:0 shutting down...
I20260709 12:25:15.038743  3873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:15.039564  3873 tablet_replica.cc:333] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8: stopping tablet replica
I20260709 12:25:15.040506  3873 raft_consensus.cc:2243] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:15.041754  3873 raft_consensus.cc:2272] T 1502de7867d7495bb2a73420c7190153 P 04d87c7382a4441da74afbdaee7db6f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.043525  3873 tablet_replica.cc:333] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8: stopping tablet replica
I20260709 12:25:15.044085  3873 raft_consensus.cc:2243] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:15.044948  3873 raft_consensus.cc:2272] T 80c25035ddbd458b810ee7ad5b3e4855 P 04d87c7382a4441da74afbdaee7db6f8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.046797  3873 tablet_replica.cc:333] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8: stopping tablet replica
I20260709 12:25:15.047274  3873 raft_consensus.cc:2243] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:15.048017  3873 raft_consensus.cc:2272] T db3bdead2b554329a75fc42e9c661425 P 04d87c7382a4441da74afbdaee7db6f8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.049804  3873 tablet_replica.cc:333] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8: stopping tablet replica
I20260709 12:25:15.050272  3873 raft_consensus.cc:2243] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:15.050720  3873 raft_consensus.cc:2272] T 2c1b46cfb77a4d70863c1df111a27523 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.052951  3873 tablet_replica.cc:333] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8: stopping tablet replica
I20260709 12:25:15.053574  3873 raft_consensus.cc:2243] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:15.054137  3873 raft_consensus.cc:2272] T 8a8fedb0755e4ee086e2a983e5b8e4b3 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.055889  3873 tablet_replica.cc:333] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8: stopping tablet replica
I20260709 12:25:15.056417  3873 raft_consensus.cc:2243] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:15.056947  3873 raft_consensus.cc:2272] T 7183afdd01454a648af43ec00011d369 P 04d87c7382a4441da74afbdaee7db6f8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.058482  3873 tablet_replica.cc:333] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8: stopping tablet replica
I20260709 12:25:15.058941  3873 raft_consensus.cc:2243] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:15.059335  3873 raft_consensus.cc:2272] T d72d31ebf33b4960ac55664142d46f32 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.060950  3873 tablet_replica.cc:333] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8: stopping tablet replica
I20260709 12:25:15.061399  3873 raft_consensus.cc:2243] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:15.061787  3873 raft_consensus.cc:2272] T 9db9913c3c0e4ff4ae3afb2a1446a948 P 04d87c7382a4441da74afbdaee7db6f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.063329  3873 tablet_replica.cc:333] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8: stopping tablet replica
I20260709 12:25:15.063763  3873 raft_consensus.cc:2243] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:15.064158  3873 raft_consensus.cc:2272] T 3d1b4e857aff48e296a9a69c27a84ac2 P 04d87c7382a4441da74afbdaee7db6f8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.091581  3873 tablet_server.cc:196] TabletServer@127.3.200.67:0 shutdown complete.
I20260709 12:25:15.110570  3873 master.cc:562] Master@127.3.200.126:42665 shutting down...
I20260709 12:25:15.311491  3873 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:15.312155  3873 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.312516  3873 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0560adfdcd774694bc6ccb95038c1941: stopping tablet replica
I20260709 12:25:15.349426  3873 master.cc:584] Master@127.3.200.126:42665 shutdown complete.
04d87c7382a4441da74afbdaee7db6f8  1
1b10efe7f4e34d9d84606f74160c6624  4
a4d2a27c4d354c05b90ef41591eceb9c  4
04d87c7382a4441da74afbdaee7db6f8  3
1b10efe7f4e34d9d84606f74160c6624  3
a4d2a27c4d354c05b90ef41591eceb9c  3
04d87c7382a4441da74afbdaee7db6f8  1
1b10efe7f4e34d9d84606f74160c6624  0
a4d2a27c4d354c05b90ef41591eceb9c  8
04d87c7382a4441da74afbdaee7db6f8  3
1b10efe7f4e34d9d84606f74160c6624  3
a4d2a27c4d354c05b90ef41591eceb9c  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31048 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:25:15.393450  3873 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.200.126:39375
I20260709 12:25:15.394608  3873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:15.399945  4399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:15.400102  4398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:15.401503  4401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:15.402222  3873 server_base.cc:1061] running on GCE node
I20260709 12:25:15.403195  3873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:15.403401  3873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:15.403556  3873 hybrid_clock.cc:648] HybridClock initialized: now 1783599915403541 us; error 0 us; skew 500 ppm
I20260709 12:25:15.404080  3873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:15.406759  3873 webserver.cc:533] Webserver started at http://127.3.200.126:43269/ using document root <none> and password file <none>
I20260709 12:25:15.407246  3873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:15.407459  3873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:15.407727  3873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:15.409200  3873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/master-0-root/instance:
uuid: "f0662c1578d041e08e8483aec97790d3"
format_stamp: "Formatted at 2026-07-09 12:25:15 on dist-test-slave-px1m"
I20260709 12:25:15.413950  3873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:25:15.417407  4406 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.418205  3873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:15.418514  3873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/master-0-root
uuid: "f0662c1578d041e08e8483aec97790d3"
format_stamp: "Formatted at 2026-07-09 12:25:15 on dist-test-slave-px1m"
I20260709 12:25:15.418810  3873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:15.437934  3873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:15.439196  3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:15.476845  3873 rpc_server.cc:307] RPC server started. Bound to: 127.3.200.126:39375
I20260709 12:25:15.476974  4458 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.200.126:39375 every 8 connection(s)
I20260709 12:25:15.480675  4459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.490103  4459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3: Bootstrap starting.
I20260709 12:25:15.495002  4459 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.499306  4459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3: No bootstrap required, opened a new log
I20260709 12:25:15.501543  4459 raft_consensus.cc:359] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0662c1578d041e08e8483aec97790d3" member_type: VOTER }
I20260709 12:25:15.501994  4459 raft_consensus.cc:385] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.502218  4459 raft_consensus.cc:740] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0662c1578d041e08e8483aec97790d3, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.502794  4459 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0662c1578d041e08e8483aec97790d3" member_type: VOTER }
I20260709 12:25:15.503258  4459 raft_consensus.cc:399] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:15.503480  4459 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:15.503773  4459 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.507673  4459 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0662c1578d041e08e8483aec97790d3" member_type: VOTER }
I20260709 12:25:15.508186  4459 leader_election.cc:304] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0662c1578d041e08e8483aec97790d3; no voters: 
I20260709 12:25:15.509464  4459 leader_election.cc:290] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:15.509871  4462 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:15.511238  4462 raft_consensus.cc:697] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [term 1 LEADER]: Becoming Leader. State: Replica: f0662c1578d041e08e8483aec97790d3, State: Running, Role: LEADER
I20260709 12:25:15.512003  4462 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0662c1578d041e08e8483aec97790d3" member_type: VOTER }
I20260709 12:25:15.512405  4459 sys_catalog.cc:565] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:15.517417  4464 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0662c1578d041e08e8483aec97790d3. Latest consensus state: current_term: 1 leader_uuid: "f0662c1578d041e08e8483aec97790d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0662c1578d041e08e8483aec97790d3" member_type: VOTER } }
I20260709 12:25:15.518103  4463 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0662c1578d041e08e8483aec97790d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0662c1578d041e08e8483aec97790d3" member_type: VOTER } }
I20260709 12:25:15.518339  4464 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:15.518705  4463 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:15.520848  4471 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:15.526160  4471 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:15.530223  3873 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:15.535518  4471 catalog_manager.cc:1383] Generated new cluster ID: ebb0ea1b4dce4392b5bcc14a4b46eb68
I20260709 12:25:15.535878  4471 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:15.555166  4471 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:15.556437  4471 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:15.571098  4471 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3: Generated new TSK 0
I20260709 12:25:15.571945  4471 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:15.596973  3873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:15.603092  4480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:15.603845  4481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:15.604990  4483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:15.605907  3873 server_base.cc:1061] running on GCE node
I20260709 12:25:15.607203  3873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:15.607507  3873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:15.607729  3873 hybrid_clock.cc:648] HybridClock initialized: now 1783599915607709 us; error 0 us; skew 500 ppm
I20260709 12:25:15.608616  3873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:15.612906  3873 webserver.cc:533] Webserver started at http://127.3.200.65:46197/ using document root <none> and password file <none>
I20260709 12:25:15.613611  3873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:15.613883  3873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:15.614228  3873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:15.615883  3873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/ts-0-root/instance:
uuid: "481fa219fb0146dfac14a92f2cb8f134"
format_stamp: "Formatted at 2026-07-09 12:25:15 on dist-test-slave-px1m"
I20260709 12:25:15.620306  3873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:25:15.623656  4488 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.624419  3873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:15.624780  3873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/ts-0-root
uuid: "481fa219fb0146dfac14a92f2cb8f134"
format_stamp: "Formatted at 2026-07-09 12:25:15 on dist-test-slave-px1m"
I20260709 12:25:15.625051  3873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:15.646760  3873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:15.647994  3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:15.649605  3873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:15.652099  3873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:15.652330  3873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.652655  3873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:15.652849  3873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.691793  3873 rpc_server.cc:307] RPC server started. Bound to: 127.3.200.65:45409
I20260709 12:25:15.691884  4550 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.200.65:45409 every 8 connection(s)
I20260709 12:25:15.696883  3873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:15.703802  4555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:15.704782  4556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:15.707999  3873 server_base.cc:1061] running on GCE node
W20260709 12:25:15.708102  4558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:15.709264  3873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:15.709482  3873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:15.709713  3873 hybrid_clock.cc:648] HybridClock initialized: now 1783599915709693 us; error 0 us; skew 500 ppm
I20260709 12:25:15.710217  3873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:15.712955  3873 webserver.cc:533] Webserver started at http://127.3.200.66:34927/ using document root <none> and password file <none>
I20260709 12:25:15.713608  3873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:15.713810  3873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:15.714073  3873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:15.714530  4551 heartbeater.cc:344] Connected to a master server at 127.3.200.126:39375
I20260709 12:25:15.714877  4551 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:15.715373  3873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/ts-1-root/instance:
uuid: "3a617de8b64b4d698b80dc8d986b5e75"
format_stamp: "Formatted at 2026-07-09 12:25:15 on dist-test-slave-px1m"
I20260709 12:25:15.715641  4551 heartbeater.cc:507] Master 127.3.200.126:39375 requested a full tablet report, sending...
I20260709 12:25:15.717821  4423 ts_manager.cc:194] Registered new tserver with Master: 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409)
I20260709 12:25:15.720132  4423 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41022
I20260709 12:25:15.720445  3873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:25:15.724025  4563 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.724825  3873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:15.725107  3873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/ts-1-root
uuid: "3a617de8b64b4d698b80dc8d986b5e75"
format_stamp: "Formatted at 2026-07-09 12:25:15 on dist-test-slave-px1m"
I20260709 12:25:15.725389  3873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:15.749776  3873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:15.750999  3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:15.752429  3873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:15.754738  3873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:15.754921  3873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.755225  3873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:15.755366  3873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.794806  3873 rpc_server.cc:307] RPC server started. Bound to: 127.3.200.66:46317
I20260709 12:25:15.794912  4625 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.200.66:46317 every 8 connection(s)
I20260709 12:25:15.799530  3873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:15.806362  4629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:15.807163  4630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:15.810496  3873 server_base.cc:1061] running on GCE node
I20260709 12:25:15.811386  4626 heartbeater.cc:344] Connected to a master server at 127.3.200.126:39375
W20260709 12:25:15.811538  4632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:15.811811  4626 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:15.812600  3873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:15.812878  3873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:15.812831  4626 heartbeater.cc:507] Master 127.3.200.126:39375 requested a full tablet report, sending...
I20260709 12:25:15.813218  3873 hybrid_clock.cc:648] HybridClock initialized: now 1783599915813196 us; error 0 us; skew 500 ppm
I20260709 12:25:15.814040  3873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:15.815241  4423 ts_manager.cc:194] Registered new tserver with Master: 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317)
I20260709 12:25:15.816628  3873 webserver.cc:533] Webserver started at http://127.3.200.67:34537/ using document root <none> and password file <none>
I20260709 12:25:15.816836  4423 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41034
I20260709 12:25:15.817178  3873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:15.817415  3873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:15.817777  3873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:15.819326  3873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/ts-2-root/instance:
uuid: "a46ce53289054c3b8cd158d2285506ef"
format_stamp: "Formatted at 2026-07-09 12:25:15 on dist-test-slave-px1m"
I20260709 12:25:15.823812  3873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 12:25:15.827126  4637 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.827922  3873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:25:15.828235  3873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/ts-2-root
uuid: "a46ce53289054c3b8cd158d2285506ef"
format_stamp: "Formatted at 2026-07-09 12:25:15 on dist-test-slave-px1m"
I20260709 12:25:15.828474  3873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599884178482-3873-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:15.845022  3873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:15.846204  3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:15.847743  3873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:15.849992  3873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:15.850207  3873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.850487  3873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:15.850663  3873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.890658  3873 rpc_server.cc:307] RPC server started. Bound to: 127.3.200.67:44471
I20260709 12:25:15.890784  4699 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.200.67:44471 every 8 connection(s)
I20260709 12:25:15.905073  4700 heartbeater.cc:344] Connected to a master server at 127.3.200.126:39375
I20260709 12:25:15.905444  4700 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:15.906178  4700 heartbeater.cc:507] Master 127.3.200.126:39375 requested a full tablet report, sending...
I20260709 12:25:15.908202  4423 ts_manager.cc:194] Registered new tserver with Master: a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:15.908631  3873 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014879793s
I20260709 12:25:15.909960  4423 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41044
I20260709 12:25:15.934774  4423 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41056:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:15.937749  4423 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:16.023123  4591 tablet_service.cc:1511] Processing CreateTablet for tablet 61866bd2197541018e7751ff916bd471 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:16.024798  4591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61866bd2197541018e7751ff916bd471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.025893  4665 tablet_service.cc:1511] Processing CreateTablet for tablet 61866bd2197541018e7751ff916bd471 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:16.027685  4665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61866bd2197541018e7751ff916bd471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.028625  4587 tablet_service.cc:1511] Processing CreateTablet for tablet da90399573cd4e89bda769cee6c7d181 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:16.030129  4587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da90399573cd4e89bda769cee6c7d181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.025774  4589 tablet_service.cc:1511] Processing CreateTablet for tablet a38c80acfeef458fadf844c1e895d8f8 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:16.031972  4589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a38c80acfeef458fadf844c1e895d8f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.032076  4590 tablet_service.cc:1511] Processing CreateTablet for tablet 57692562c3c94894afe825af6d77fe58 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:16.033139  4588 tablet_service.cc:1511] Processing CreateTablet for tablet 6d589545cf8445a1bb29cdeeff34bef5 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:16.033595  4590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57692562c3c94894afe825af6d77fe58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.032465  4586 tablet_service.cc:1511] Processing CreateTablet for tablet 6cac76e593794fce9cf61281bee155ef (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:16.035733  4586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cac76e593794fce9cf61281bee155ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.045742  4585 tablet_service.cc:1511] Processing CreateTablet for tablet 9eab1ee01b0447f187f838bad18a5422 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:16.047387  4585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eab1ee01b0447f187f838bad18a5422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.051127  4583 tablet_service.cc:1511] Processing CreateTablet for tablet 7861580b029e4832b72b175f808a0ca1 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:16.051019  4584 tablet_service.cc:1511] Processing CreateTablet for tablet aec13febd4da419182593ae351aae577 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:16.055027  4588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d589545cf8445a1bb29cdeeff34bef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.058547  4664 tablet_service.cc:1511] Processing CreateTablet for tablet 57692562c3c94894afe825af6d77fe58 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:16.060130  4664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57692562c3c94894afe825af6d77fe58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.060966  4583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7861580b029e4832b72b175f808a0ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.061947  4582 tablet_service.cc:1511] Processing CreateTablet for tablet 52d137fef3dc4eaebd1a9d7c93a7b575 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:16.063519  4582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d137fef3dc4eaebd1a9d7c93a7b575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.069000  4584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec13febd4da419182593ae351aae577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.070636  4663 tablet_service.cc:1511] Processing CreateTablet for tablet a38c80acfeef458fadf844c1e895d8f8 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:16.072170  4663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a38c80acfeef458fadf844c1e895d8f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.077775  4662 tablet_service.cc:1511] Processing CreateTablet for tablet 6d589545cf8445a1bb29cdeeff34bef5 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:16.079249  4662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d589545cf8445a1bb29cdeeff34bef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.088217  4661 tablet_service.cc:1511] Processing CreateTablet for tablet da90399573cd4e89bda769cee6c7d181 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:16.089852  4661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da90399573cd4e89bda769cee6c7d181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.098707  4660 tablet_service.cc:1511] Processing CreateTablet for tablet 6cac76e593794fce9cf61281bee155ef (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:16.102342  4659 tablet_service.cc:1511] Processing CreateTablet for tablet 9eab1ee01b0447f187f838bad18a5422 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:16.105809  4658 tablet_service.cc:1511] Processing CreateTablet for tablet aec13febd4da419182593ae351aae577 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:16.109401  4657 tablet_service.cc:1511] Processing CreateTablet for tablet 7861580b029e4832b72b175f808a0ca1 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:16.110213  4656 tablet_service.cc:1511] Processing CreateTablet for tablet 52d137fef3dc4eaebd1a9d7c93a7b575 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:16.121351  4660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cac76e593794fce9cf61281bee155ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.122108  4656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d137fef3dc4eaebd1a9d7c93a7b575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.122943  4659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eab1ee01b0447f187f838bad18a5422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.124760  4658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec13febd4da419182593ae351aae577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.128926  4657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7861580b029e4832b72b175f808a0ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.175072  4513 tablet_service.cc:1511] Processing CreateTablet for tablet 6d589545cf8445a1bb29cdeeff34bef5 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:16.176772  4513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d589545cf8445a1bb29cdeeff34bef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.177913  4515 tablet_service.cc:1511] Processing CreateTablet for tablet 57692562c3c94894afe825af6d77fe58 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:16.179425  4515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57692562c3c94894afe825af6d77fe58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.181953  4514 tablet_service.cc:1511] Processing CreateTablet for tablet a38c80acfeef458fadf844c1e895d8f8 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:16.183466  4514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a38c80acfeef458fadf844c1e895d8f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.185922  4512 tablet_service.cc:1511] Processing CreateTablet for tablet da90399573cd4e89bda769cee6c7d181 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:16.188469  4511 tablet_service.cc:1511] Processing CreateTablet for tablet 6cac76e593794fce9cf61281bee155ef (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
W20260709 12:25:16.188787  4407 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.200.66:46317, user_credentials={real_user=slave}} blocked reactor thread for 50390us
I20260709 12:25:16.191108  4510 tablet_service.cc:1511] Processing CreateTablet for tablet 9eab1ee01b0447f187f838bad18a5422 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:16.176126  4516 tablet_service.cc:1511] Processing CreateTablet for tablet 61866bd2197541018e7751ff916bd471 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:16.195056  4509 tablet_service.cc:1511] Processing CreateTablet for tablet aec13febd4da419182593ae351aae577 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:16.197860  4508 tablet_service.cc:1511] Processing CreateTablet for tablet 7861580b029e4832b72b175f808a0ca1 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:16.200914  4507 tablet_service.cc:1511] Processing CreateTablet for tablet 52d137fef3dc4eaebd1a9d7c93a7b575 (DEFAULT_TABLE table=test-workload [id=635c89ee87534a4b903da71393fe6c10]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:16.205080  4512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da90399573cd4e89bda769cee6c7d181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.207794  4510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eab1ee01b0447f187f838bad18a5422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.208570  4509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec13febd4da419182593ae351aae577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.210494  4508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7861580b029e4832b72b175f808a0ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.212966  4511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cac76e593794fce9cf61281bee155ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.216967  4507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d137fef3dc4eaebd1a9d7c93a7b575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.220978  4516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61866bd2197541018e7751ff916bd471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.239521  4716 tablet_bootstrap.cc:492] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef: Bootstrap starting.
I20260709 12:25:16.246562  4716 tablet_bootstrap.cc:654] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.250084  4717 tablet_bootstrap.cc:492] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134: Bootstrap starting.
I20260709 12:25:16.267341  4717 tablet_bootstrap.cc:654] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.278831  4717 tablet_bootstrap.cc:492] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134: No bootstrap required, opened a new log
I20260709 12:25:16.279420  4717 ts_tablet_manager.cc:1403] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.008s
I20260709 12:25:16.282533  4717 raft_consensus.cc:359] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.289350  4717 raft_consensus.cc:385] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.290427  4717 raft_consensus.cc:740] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.292052  4717 consensus_queue.cc:260] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.304178  4715 tablet_bootstrap.cc:492] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75: Bootstrap starting.
I20260709 12:25:16.311748  4551 heartbeater.cc:499] Master 127.3.200.126:39375 was elected leader, sending a full tablet report...
I20260709 12:25:16.312337  4717 ts_tablet_manager.cc:1434] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.008s
I20260709 12:25:16.331524  4717 tablet_bootstrap.cc:492] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134: Bootstrap starting.
I20260709 12:25:16.338109  4715 tablet_bootstrap.cc:654] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.338814  4717 tablet_bootstrap.cc:654] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.352100  4716 tablet_bootstrap.cc:492] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef: No bootstrap required, opened a new log
I20260709 12:25:16.352639  4716 ts_tablet_manager.cc:1403] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef: Time spent bootstrapping tablet: real 0.114s	user 0.041s	sys 0.029s
I20260709 12:25:16.355788  4716 raft_consensus.cc:359] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.356546  4716 raft_consensus.cc:385] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.357086  4716 raft_consensus.cc:740] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.358106  4716 consensus_queue.cc:260] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.359064  4717 tablet_bootstrap.cc:492] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134: No bootstrap required, opened a new log
I20260709 12:25:16.359611  4717 ts_tablet_manager.cc:1403] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.006s
I20260709 12:25:16.363669  4717 raft_consensus.cc:359] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.364359  4717 raft_consensus.cc:385] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.364692  4717 raft_consensus.cc:740] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.365455  4717 consensus_queue.cc:260] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.369045  4715 tablet_bootstrap.cc:492] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75: No bootstrap required, opened a new log
I20260709 12:25:16.369539  4715 ts_tablet_manager.cc:1403] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.015s
I20260709 12:25:16.370669  4716 ts_tablet_manager.cc:1434] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.003s
I20260709 12:25:16.371518  4700 heartbeater.cc:499] Master 127.3.200.126:39375 was elected leader, sending a full tablet report...
I20260709 12:25:16.372570  4715 raft_consensus.cc:359] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } } peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } }
I20260709 12:25:16.373287  4715 raft_consensus.cc:385] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.373584  4715 raft_consensus.cc:740] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.374315  4715 consensus_queue.cc:260] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } } peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } }
I20260709 12:25:16.377194  4626 heartbeater.cc:499] Master 127.3.200.126:39375 was elected leader, sending a full tablet report...
I20260709 12:25:16.377732  4715 ts_tablet_manager.cc:1434] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:25:16.378686  4715 tablet_bootstrap.cc:492] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75: Bootstrap starting.
I20260709 12:25:16.381879  4717 ts_tablet_manager.cc:1434] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 12:25:16.385150  4715 tablet_bootstrap.cc:654] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.385964  4717 tablet_bootstrap.cc:492] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134: Bootstrap starting.
I20260709 12:25:16.386772  4716 tablet_bootstrap.cc:492] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef: Bootstrap starting.
I20260709 12:25:16.392917  4717 tablet_bootstrap.cc:654] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.393827  4716 tablet_bootstrap.cc:654] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.405414  4717 tablet_bootstrap.cc:492] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134: No bootstrap required, opened a new log
I20260709 12:25:16.405618  4715 tablet_bootstrap.cc:492] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75: No bootstrap required, opened a new log
I20260709 12:25:16.405944  4717 ts_tablet_manager.cc:1403] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 12:25:16.406045  4716 tablet_bootstrap.cc:492] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef: No bootstrap required, opened a new log
I20260709 12:25:16.406306  4715 ts_tablet_manager.cc:1403] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.009s
I20260709 12:25:16.406545  4716 ts_tablet_manager.cc:1403] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.009s
I20260709 12:25:16.409008  4717 raft_consensus.cc:359] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.409345  4716 raft_consensus.cc:359] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.409511  4715 raft_consensus.cc:359] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.410136  4716 raft_consensus.cc:385] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.409751  4717 raft_consensus.cc:385] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.410454  4715 raft_consensus.cc:385] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.410579  4717 raft_consensus.cc:740] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.410933  4715 raft_consensus.cc:740] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.411494  4717 consensus_queue.cc:260] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.410472  4716 raft_consensus.cc:740] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.412832  4716 consensus_queue.cc:260] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.415792  4716 ts_tablet_manager.cc:1434] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:25:16.414119  4717 ts_tablet_manager.cc:1434] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:25:16.416879  4716 tablet_bootstrap.cc:492] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef: Bootstrap starting.
I20260709 12:25:16.417064  4717 tablet_bootstrap.cc:492] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134: Bootstrap starting.
I20260709 12:25:16.412129  4715 consensus_queue.cc:260] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.424052  4715 ts_tablet_manager.cc:1434] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.003s
I20260709 12:25:16.424217  4716 tablet_bootstrap.cc:654] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.425089  4715 tablet_bootstrap.cc:492] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75: Bootstrap starting.
I20260709 12:25:16.424217  4717 tablet_bootstrap.cc:654] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.432489  4715 tablet_bootstrap.cc:654] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.455847  4716 tablet_bootstrap.cc:492] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef: No bootstrap required, opened a new log
I20260709 12:25:16.456398  4716 ts_tablet_manager.cc:1403] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.017s
I20260709 12:25:16.456990  4715 tablet_bootstrap.cc:492] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75: No bootstrap required, opened a new log
I20260709 12:25:16.457263  4717 tablet_bootstrap.cc:492] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134: No bootstrap required, opened a new log
I20260709 12:25:16.457448  4715 ts_tablet_manager.cc:1403] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.016s
I20260709 12:25:16.457890  4717 ts_tablet_manager.cc:1403] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.017s
I20260709 12:25:16.459702  4716 raft_consensus.cc:359] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.459877  4715 raft_consensus.cc:359] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.460511  4716 raft_consensus.cc:385] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.460672  4715 raft_consensus.cc:385] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.460884  4716 raft_consensus.cc:740] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.461066  4715 raft_consensus.cc:740] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.460837  4717 raft_consensus.cc:359] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.461642  4717 raft_consensus.cc:385] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.461968  4717 raft_consensus.cc:740] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.461771  4716 consensus_queue.cc:260] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.462062  4715 consensus_queue.cc:260] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.462806  4717 consensus_queue.cc:260] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.463941  4716 ts_tablet_manager.cc:1434] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:25:16.464900  4716 tablet_bootstrap.cc:492] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef: Bootstrap starting.
I20260709 12:25:16.466555  4715 ts_tablet_manager.cc:1434] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:25:16.467283  4717 ts_tablet_manager.cc:1434] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:25:16.467609  4715 tablet_bootstrap.cc:492] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75: Bootstrap starting.
I20260709 12:25:16.468286  4717 tablet_bootstrap.cc:492] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 481fa219fb0146dfac14a92f2cb8f134: Bootstrap starting.
I20260709 12:25:16.471251  4716 tablet_bootstrap.cc:654] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.474803  4715 tablet_bootstrap.cc:654] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.475582  4717 tablet_bootstrap.cc:654] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 481fa219fb0146dfac14a92f2cb8f134: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.487214  4715 tablet_bootstrap.cc:492] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75: No bootstrap required, opened a new log
I20260709 12:25:16.487723  4715 ts_tablet_manager.cc:1403] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 12:25:16.490574  4715 raft_consensus.cc:359] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.491489  4715 raft_consensus.cc:385] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.491815  4715 raft_consensus.cc:740] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.492805  4715 consensus_queue.cc:260] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.495225  4715 ts_tablet_manager.cc:1434] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:25:16.496219  4715 tablet_bootstrap.cc:492] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75: Bootstrap starting.
I20260709 12:25:16.502746  4715 tablet_bootstrap.cc:654] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.510919  4716 tablet_bootstrap.cc:492] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef: No bootstrap required, opened a new log
I20260709 12:25:16.511152  4715 tablet_bootstrap.cc:492] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75: No bootstrap required, opened a new log
I20260709 12:25:16.511595  4716 ts_tablet_manager.cc:1403] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.033s
I20260709 12:25:16.511660  4717 tablet_bootstrap.cc:492] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 481fa219fb0146dfac14a92f2cb8f134: No bootstrap required, opened a new log
I20260709 12:25:16.511679  4715 ts_tablet_manager.cc:1403] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75: Time spent bootstrapping tablet: real 0.016s	user 0.004s	sys 0.007s
I20260709 12:25:16.512240  4717 ts_tablet_manager.cc:1403] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 481fa219fb0146dfac14a92f2cb8f134: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.027s
I20260709 12:25:16.514389  4715 raft_consensus.cc:359] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.514981  4715 raft_consensus.cc:385] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.514783  4716 raft_consensus.cc:359] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } } peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } }
I20260709 12:25:16.515303  4715 raft_consensus.cc:740] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.515158  4717 raft_consensus.cc:359] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.515584  4716 raft_consensus.cc:385] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.515920  4717 raft_consensus.cc:385] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.515941  4716 raft_consensus.cc:740] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.516352  4717 raft_consensus.cc:740] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.516057  4715 consensus_queue.cc:260] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.516971  4716 consensus_queue.cc:260] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } } peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } }
I20260709 12:25:16.517100  4717 consensus_queue.cc:260] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.519706  4717 ts_tablet_manager.cc:1434] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 481fa219fb0146dfac14a92f2cb8f134: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:16.519830  4724 raft_consensus.cc:493] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.520310  4724 raft_consensus.cc:515] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.520665  4723 raft_consensus.cc:493] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.521317  4723 raft_consensus.cc:515] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.522068  4715 ts_tablet_manager.cc:1434] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:25:16.522367  4716 ts_tablet_manager.cc:1434] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:25:16.523065  4715 tablet_bootstrap.cc:492] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75: Bootstrap starting.
I20260709 12:25:16.523499  4716 tablet_bootstrap.cc:492] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef: Bootstrap starting.
I20260709 12:25:16.529150  4724 leader_election.cc:290] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:16.529716  4724 raft_consensus.cc:493] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.530174  4724 raft_consensus.cc:515] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.532125  4715 tablet_bootstrap.cc:654] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.532078  4716 tablet_bootstrap.cc:654] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.534169  4723 leader_election.cc:290] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317)
I20260709 12:25:16.520665  4717 tablet_bootstrap.cc:492] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134: Bootstrap starting.
W20260709 12:25:16.524408  4472 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:16.532269  4724 leader_election.cc:290] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:16.550074  4716 tablet_bootstrap.cc:492] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef: No bootstrap required, opened a new log
I20260709 12:25:16.550648  4716 ts_tablet_manager.cc:1403] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.000s
I20260709 12:25:16.558410  4723 raft_consensus.cc:493] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.558926  4723 raft_consensus.cc:515] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.560983  4723 leader_election.cc:290] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317)
I20260709 12:25:16.573140  4716 raft_consensus.cc:359] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.573952  4716 raft_consensus.cc:385] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.574262  4716 raft_consensus.cc:740] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.575007  4716 consensus_queue.cc:260] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.576582  4717 tablet_bootstrap.cc:654] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.579349  4723 raft_consensus.cc:493] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.580080  4716 ts_tablet_manager.cc:1434] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 12:25:16.579834  4723 raft_consensus.cc:515] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } } peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } }
I20260709 12:25:16.580541  4715 tablet_bootstrap.cc:492] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75: No bootstrap required, opened a new log
I20260709 12:25:16.581059  4715 ts_tablet_manager.cc:1403] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.003s
I20260709 12:25:16.581168  4716 tablet_bootstrap.cc:492] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef: Bootstrap starting.
I20260709 12:25:16.581960  4723 leader_election.cc:290] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317), 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409)
I20260709 12:25:16.584000  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57692562c3c94894afe825af6d77fe58" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134" is_pre_election: true
I20260709 12:25:16.584306  4715 raft_consensus.cc:359] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.585237  4715 raft_consensus.cc:385] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.585592  4715 raft_consensus.cc:740] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.586398  4715 consensus_queue.cc:260] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.586912  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38c80acfeef458fadf844c1e895d8f8" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134" is_pre_election: true
W20260709 12:25:16.587054  4640 leader_election.cc:343] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.587883  4525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61866bd2197541018e7751ff916bd471" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134" is_pre_election: true
I20260709 12:25:16.590018  4716 tablet_bootstrap.cc:654] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.589967  4601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57692562c3c94894afe825af6d77fe58" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75" is_pre_election: true
I20260709 12:25:16.590701  4715 ts_tablet_manager.cc:1434] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:25:16.591619  4600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38c80acfeef458fadf844c1e895d8f8" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75" is_pre_election: true
I20260709 12:25:16.591867  4715 tablet_bootstrap.cc:492] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75: Bootstrap starting.
I20260709 12:25:16.592998  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61866bd2197541018e7751ff916bd471" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75" is_pre_election: true
I20260709 12:25:16.593660  4599 raft_consensus.cc:2468] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 0.
W20260709 12:25:16.595561  4638 leader_election.cc:343] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.595994  4638 leader_election.cc:304] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46ce53289054c3b8cd158d2285506ef; no voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134
I20260709 12:25:16.596768  4723 raft_consensus.cc:2749] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:16.597183  4638 leader_election.cc:343] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.597837  4638 leader_election.cc:304] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, a46ce53289054c3b8cd158d2285506ef; no voters: 
I20260709 12:25:16.598572  4723 raft_consensus.cc:2804] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.598928  4723 raft_consensus.cc:493] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.599247  4723 raft_consensus.cc:3060] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.601369  4715 tablet_bootstrap.cc:654] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.601915  4526 raft_consensus.cc:2468] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 0.
W20260709 12:25:16.603475  4640 leader_election.cc:343] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.604398  4640 leader_election.cc:304] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481fa219fb0146dfac14a92f2cb8f134, a46ce53289054c3b8cd158d2285506ef; no voters: 3a617de8b64b4d698b80dc8d986b5e75
I20260709 12:25:16.606503  4723 raft_consensus.cc:515] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } } peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } }
I20260709 12:25:16.609690  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61866bd2197541018e7751ff916bd471" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:16.610277  4599 raft_consensus.cc:3060] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.610721  4723 leader_election.cc:290] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 election: Requested vote from peers 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317), 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409)
I20260709 12:25:16.612586  4723 raft_consensus.cc:2804] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.613016  4723 raft_consensus.cc:493] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.614418  4723 raft_consensus.cc:3060] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.616900  4715 tablet_bootstrap.cc:492] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75: No bootstrap required, opened a new log
I20260709 12:25:16.616935  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134" is_pre_election: true
I20260709 12:25:16.617602  4715 ts_tablet_manager.cc:1403] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.007s
I20260709 12:25:16.617865  4526 raft_consensus.cc:2468] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 0.
I20260709 12:25:16.620689  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134" is_pre_election: true
I20260709 12:25:16.621343  4526 raft_consensus.cc:2468] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 0.
I20260709 12:25:16.621091  4715 raft_consensus.cc:359] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.622169  4715 raft_consensus.cc:385] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.622637  4715 raft_consensus.cc:740] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.623716  4740 raft_consensus.cc:493] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.623688  4715 consensus_queue.cc:260] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.624428  4740 raft_consensus.cc:515] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.627941  4715 ts_tablet_manager.cc:1434] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.008s
I20260709 12:25:16.630609  4715 tablet_bootstrap.cc:492] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75: Bootstrap starting.
I20260709 12:25:16.631511  4740 leader_election.cc:290] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:16.628113  4723 raft_consensus.cc:515] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.636024  4723 leader_election.cc:290] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317)
I20260709 12:25:16.636958  4600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38c80acfeef458fadf844c1e895d8f8" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
W20260709 12:25:16.638777  4638 leader_election.cc:343] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.640076  4715 tablet_bootstrap.cc:654] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.641407  4599 raft_consensus.cc:2468] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 1.
I20260709 12:25:16.642951  4638 leader_election.cc:304] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, a46ce53289054c3b8cd158d2285506ef; no voters: 
I20260709 12:25:16.643940  4723 raft_consensus.cc:2804] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.644694  4723 raft_consensus.cc:697] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Becoming Leader. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Running, Role: LEADER
I20260709 12:25:16.644994  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61866bd2197541018e7751ff916bd471" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:16.645646  4723 consensus_queue.cc:237] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } } peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } }
I20260709 12:25:16.647317  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38c80acfeef458fadf844c1e895d8f8" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:16.647871  4526 raft_consensus.cc:3060] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:16.654072  4640 leader_election.cc:343] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.656637  4715 tablet_bootstrap.cc:492] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75: No bootstrap required, opened a new log
I20260709 12:25:16.657393  4715 ts_tablet_manager.cc:1403] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.013s
I20260709 12:25:16.657337  4566 leader_election.cc:304] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: 
I20260709 12:25:16.659157  4724 raft_consensus.cc:2804] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.659273  4566 leader_election.cc:304] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: 
I20260709 12:25:16.659816  4724 raft_consensus.cc:493] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.658272  4740 raft_consensus.cc:493] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.660369  4724 raft_consensus.cc:3060] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.660730  4740 raft_consensus.cc:515] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.662850  4740 leader_election.cc:290] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:16.663432  4740 raft_consensus.cc:2804] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.663774  4740 raft_consensus.cc:493] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.664132  4740 raft_consensus.cc:3060] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.667475  4723 raft_consensus.cc:493] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.668042  4723 raft_consensus.cc:515] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.671134  4723 leader_election.cc:290] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317)
I20260709 12:25:16.673026  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac76e593794fce9cf61281bee155ef" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75" is_pre_election: true
I20260709 12:25:16.673854  4599 raft_consensus.cc:2468] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 0.
I20260709 12:25:16.675222  4638 leader_election.cc:304] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, a46ce53289054c3b8cd158d2285506ef; no voters: 
I20260709 12:25:16.675698  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46ce53289054c3b8cd158d2285506ef" is_pre_election: true
I20260709 12:25:16.675871  4724 raft_consensus.cc:515] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.676136  4723 raft_consensus.cc:2804] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.676765  4723 raft_consensus.cc:493] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.676642  4525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac76e593794fce9cf61281bee155ef" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134" is_pre_election: true
I20260709 12:25:16.677230  4674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46ce53289054c3b8cd158d2285506ef" is_pre_election: true
I20260709 12:25:16.678251  4723 raft_consensus.cc:3060] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.678478  4724 leader_election.cc:290] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:16.672021  4715 raft_consensus.cc:359] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.682277  4715 raft_consensus.cc:385] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.682633  4715 raft_consensus.cc:740] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.684924  4715 consensus_queue.cc:260] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.686861  4720 raft_consensus.cc:493] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.687345  4720 raft_consensus.cc:515] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.671984  4420 catalog_manager.cc:5697] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef reported cstate change: term changed from 0 to 1, leader changed from <none> to a46ce53289054c3b8cd158d2285506ef (127.3.200.67). New cstate: current_term: 1 leader_uuid: "a46ce53289054c3b8cd158d2285506ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:16.692075  4715 ts_tablet_manager.cc:1434] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.003s
I20260709 12:25:16.693440  4715 tablet_bootstrap.cc:492] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75: Bootstrap starting.
I20260709 12:25:16.698077  4748 raft_consensus.cc:493] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.698642  4748 raft_consensus.cc:515] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.699330  4720 leader_election.cc:290] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:16.684755  4526 raft_consensus.cc:2468] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 1.
I20260709 12:25:16.710409  4717 tablet_bootstrap.cc:492] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134: No bootstrap required, opened a new log
I20260709 12:25:16.712237  4748 leader_election.cc:290] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317)
W20260709 12:25:16.696007  4640 leader_election.cc:343] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.714963  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d137fef3dc4eaebd1a9d7c93a7b575" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75" is_pre_election: true
I20260709 12:25:16.715600  4599 raft_consensus.cc:2468] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 0.
I20260709 12:25:16.716857  4638 leader_election.cc:304] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, a46ce53289054c3b8cd158d2285506ef; no voters: 
I20260709 12:25:16.717860  4748 raft_consensus.cc:2804] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:25:16.718128  4566 leader_election.cc:343] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.718257  4748 raft_consensus.cc:493] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.718655  4748 raft_consensus.cc:3060] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:16.719151  4566 leader_election.cc:343] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.723539  4740 raft_consensus.cc:515] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.726117  4674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d137fef3dc4eaebd1a9d7c93a7b575" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46ce53289054c3b8cd158d2285506ef" is_pre_election: true
I20260709 12:25:16.726853  4748 raft_consensus.cc:515] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.727600  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7861580b029e4832b72b175f808a0ca1" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46ce53289054c3b8cd158d2285506ef" is_pre_election: true
I20260709 12:25:16.727656  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d137fef3dc4eaebd1a9d7c93a7b575" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134" is_pre_election: true
I20260709 12:25:16.728236  4674 raft_consensus.cc:2393] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a617de8b64b4d698b80dc8d986b5e75 in current term 1: Already voted for candidate a46ce53289054c3b8cd158d2285506ef in this term.
I20260709 12:25:16.728644  4526 raft_consensus.cc:2468] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 0.
I20260709 12:25:16.729765  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:16.731187  4640 leader_election.cc:304] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481fa219fb0146dfac14a92f2cb8f134, a46ce53289054c3b8cd158d2285506ef; no voters: 3a617de8b64b4d698b80dc8d986b5e75
I20260709 12:25:16.715092  4717 ts_tablet_manager.cc:1403] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134: Time spent bootstrapping tablet: real 0.195s	user 0.035s	sys 0.010s
I20260709 12:25:16.735673  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d137fef3dc4eaebd1a9d7c93a7b575" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134" is_pre_election: true
I20260709 12:25:16.736372  4526 raft_consensus.cc:2468] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 0.
I20260709 12:25:16.737439  4716 tablet_bootstrap.cc:492] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef: No bootstrap required, opened a new log
I20260709 12:25:16.737962  4716 ts_tablet_manager.cc:1403] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef: Time spent bootstrapping tablet: real 0.157s	user 0.046s	sys 0.057s
I20260709 12:25:16.738929  4525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:16.737775  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7861580b029e4832b72b175f808a0ca1" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134" is_pre_election: true
I20260709 12:25:16.739913  4525 raft_consensus.cc:3060] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.742055  4716 raft_consensus.cc:359] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.742930  4723 raft_consensus.cc:515] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.743626  4717 raft_consensus.cc:359] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.744302  4717 raft_consensus.cc:385] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.744598  4717 raft_consensus.cc:740] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.745281  4717 consensus_queue.cc:260] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.742774  4716 raft_consensus.cc:385] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.747164  4715 tablet_bootstrap.cc:654] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.747613  4525 raft_consensus.cc:2468] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 1.
I20260709 12:25:16.748311  4716 raft_consensus.cc:740] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.748898  4566 leader_election.cc:304] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: 
I20260709 12:25:16.749089  4716 consensus_queue.cc:260] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.750007  4724 raft_consensus.cc:2804] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.753085  4724 raft_consensus.cc:493] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.753455  4724 raft_consensus.cc:3060] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:16.755303  4566 leader_election.cc:343] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.756520  4723 leader_election.cc:290] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317)
I20260709 12:25:16.757754  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac76e593794fce9cf61281bee155ef" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:16.758136  4723 raft_consensus.cc:2804] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.758347  4599 raft_consensus.cc:3060] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.758783  4723 raft_consensus.cc:697] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Becoming Leader. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Running, Role: LEADER
I20260709 12:25:16.759672  4723 consensus_queue.cc:237] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.761993  4724 raft_consensus.cc:515] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.764878  4724 leader_election.cc:290] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:16.766206  4740 leader_election.cc:290] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:16.766662  4599 raft_consensus.cc:2468] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 1.
I20260709 12:25:16.767006  4566 leader_election.cc:304] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: 
I20260709 12:25:16.767711  4748 leader_election.cc:290] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317)
I20260709 12:25:16.767907  4740 raft_consensus.cc:2804] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:16.770767  4566 leader_election.cc:343] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.768270  4638 leader_election.cc:304] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, a46ce53289054c3b8cd158d2285506ef; no voters: 
I20260709 12:25:16.772274  4566 leader_election.cc:304] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75; no voters: 481fa219fb0146dfac14a92f2cb8f134, a46ce53289054c3b8cd158d2285506ef
I20260709 12:25:16.772584  4525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac76e593794fce9cf61281bee155ef" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:16.772805  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d137fef3dc4eaebd1a9d7c93a7b575" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:16.773208  4525 raft_consensus.cc:3060] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:16.773540  4566 leader_election.cc:343] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.773869  4599 raft_consensus.cc:2393] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a46ce53289054c3b8cd158d2285506ef in current term 1: Already voted for candidate 3a617de8b64b4d698b80dc8d986b5e75 in this term.
I20260709 12:25:16.775876  4717 ts_tablet_manager.cc:1434] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 12:25:16.776839  4751 raft_consensus.cc:2749] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:16.777010  4717 tablet_bootstrap.cc:492] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134: Bootstrap starting.
I20260709 12:25:16.775962  4758 raft_consensus.cc:2804] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.777881  4758 raft_consensus.cc:697] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Becoming Leader. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Running, Role: LEADER
I20260709 12:25:16.779141  4758 consensus_queue.cc:237] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.768477  4740 raft_consensus.cc:697] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 LEADER]: Becoming Leader. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Running, Role: LEADER
I20260709 12:25:16.796500  4715 tablet_bootstrap.cc:492] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75: No bootstrap required, opened a new log
I20260709 12:25:16.797161  4715 ts_tablet_manager.cc:1403] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75: Time spent bootstrapping tablet: real 0.104s	user 0.015s	sys 0.003s
I20260709 12:25:16.799546  4525 raft_consensus.cc:2468] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 1.
I20260709 12:25:16.801528  4740 consensus_queue.cc:237] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.802618  4715 raft_consensus.cc:359] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.805114  4715 raft_consensus.cc:385] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.805630  4715 raft_consensus.cc:740] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.809293  4715 consensus_queue.cc:260] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.812146  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:16.812811  4526 raft_consensus.cc:3060] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.817188  4715 ts_tablet_manager.cc:1434] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.002s
I20260709 12:25:16.818163  4715 tablet_bootstrap.cc:492] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75: Bootstrap starting.
I20260709 12:25:16.818822  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eab1ee01b0447f187f838bad18a5422" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46ce53289054c3b8cd158d2285506ef" is_pre_election: true
I20260709 12:25:16.819470  4674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d137fef3dc4eaebd1a9d7c93a7b575" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:16.822409  4674 raft_consensus.cc:2393] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3a617de8b64b4d698b80dc8d986b5e75 in current term 1: Already voted for candidate a46ce53289054c3b8cd158d2285506ef in this term.
I20260709 12:25:16.822724  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eab1ee01b0447f187f838bad18a5422" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75" is_pre_election: true
W20260709 12:25:16.823184  4491 leader_election.cc:343] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.823414  4599 raft_consensus.cc:2468] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 0.
I20260709 12:25:16.824816  4525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d137fef3dc4eaebd1a9d7c93a7b575" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:16.825241  4673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:16.825510  4525 raft_consensus.cc:3060] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.819972  4524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52d137fef3dc4eaebd1a9d7c93a7b575" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:16.829558  4715 tablet_bootstrap.cc:654] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.828248  4717 tablet_bootstrap.cc:654] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.831077  4489 leader_election.cc:304] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: a46ce53289054c3b8cd158d2285506ef
I20260709 12:25:16.831913  4720 raft_consensus.cc:2804] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.833016  4720 raft_consensus.cc:493] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.833529  4720 raft_consensus.cc:3060] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.833930  4525 raft_consensus.cc:2468] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 1.
I20260709 12:25:16.834162  4566 leader_election.cc:304] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75; no voters: 481fa219fb0146dfac14a92f2cb8f134, a46ce53289054c3b8cd158d2285506ef
I20260709 12:25:16.834564  4716 ts_tablet_manager.cc:1434] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef: Time spent starting tablet: real 0.096s	user 0.028s	sys 0.006s
I20260709 12:25:16.835237  4724 raft_consensus.cc:2749] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:16.836041  4716 tablet_bootstrap.cc:492] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef: Bootstrap starting.
W20260709 12:25:16.836701  4566 leader_election.cc:343] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.837693  4640 leader_election.cc:304] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 481fa219fb0146dfac14a92f2cb8f134, a46ce53289054c3b8cd158d2285506ef; no voters: 3a617de8b64b4d698b80dc8d986b5e75
I20260709 12:25:16.838578  4760 raft_consensus.cc:2804] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.839057  4760 raft_consensus.cc:697] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Becoming Leader. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Running, Role: LEADER
I20260709 12:25:16.839916  4760 consensus_queue.cc:237] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.833515  4526 raft_consensus.cc:2468] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 1.
I20260709 12:25:16.843817  4566 leader_election.cc:304] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: a46ce53289054c3b8cd158d2285506ef
I20260709 12:25:16.844318  4720 raft_consensus.cc:515] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.845016  4724 raft_consensus.cc:2804] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.845469  4724 raft_consensus.cc:697] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 LEADER]: Becoming Leader. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Running, Role: LEADER
I20260709 12:25:16.846400  4720 leader_election.cc:290] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 1 election: Requested vote from peers 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:16.846217  4724 consensus_queue.cc:237] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.847975  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eab1ee01b0447f187f838bad18a5422" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:16.848515  4599 raft_consensus.cc:3060] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.849108  4673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eab1ee01b0447f187f838bad18a5422" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:16.849263  4716 tablet_bootstrap.cc:654] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:16.853763  4491 leader_election.cc:343] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.866474  4715 tablet_bootstrap.cc:492] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75: No bootstrap required, opened a new log
I20260709 12:25:16.867072  4715 ts_tablet_manager.cc:1403] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.013s
I20260709 12:25:16.868119  4420 catalog_manager.cc:5697] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef reported cstate change: term changed from 0 to 1, leader changed from <none> to a46ce53289054c3b8cd158d2285506ef (127.3.200.67). New cstate: current_term: 1 leader_uuid: "a46ce53289054c3b8cd158d2285506ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.870004  4715 raft_consensus.cc:359] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.870730  4715 raft_consensus.cc:385] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.871079  4715 raft_consensus.cc:740] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.872999  4715 consensus_queue.cc:260] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.870476  4420 catalog_manager.cc:5697] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef reported cstate change: term changed from 0 to 1, leader changed from <none> to a46ce53289054c3b8cd158d2285506ef (127.3.200.67). New cstate: current_term: 1 leader_uuid: "a46ce53289054c3b8cd158d2285506ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.881819  4716 tablet_bootstrap.cc:492] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef: No bootstrap required, opened a new log
I20260709 12:25:16.882419  4716 ts_tablet_manager.cc:1403] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.003s
I20260709 12:25:16.882665  4599 raft_consensus.cc:2468] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 1.
I20260709 12:25:16.884086  4489 leader_election.cc:304] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: a46ce53289054c3b8cd158d2285506ef
I20260709 12:25:16.884949  4715 ts_tablet_manager.cc:1434] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:25:16.885308  4720 raft_consensus.cc:2804] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.887467  4717 tablet_bootstrap.cc:492] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134: No bootstrap required, opened a new log
I20260709 12:25:16.887457  4760 raft_consensus.cc:493] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.888415  4717 ts_tablet_manager.cc:1403] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134: Time spent bootstrapping tablet: real 0.112s	user 0.017s	sys 0.022s
I20260709 12:25:16.888445  4760 raft_consensus.cc:515] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.891671  4760 leader_election.cc:290] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317)
I20260709 12:25:16.886785  4716 raft_consensus.cc:359] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.891863  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec13febd4da419182593ae351aae577" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134" is_pre_election: true
I20260709 12:25:16.891327  4423 catalog_manager.cc:5697] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66). New cstate: current_term: 1 leader_uuid: "3a617de8b64b4d698b80dc8d986b5e75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:16.892307  4716 raft_consensus.cc:385] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.892674  4716 raft_consensus.cc:740] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.892912  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec13febd4da419182593ae351aae577" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75" is_pre_election: true
W20260709 12:25:16.893461  4640 leader_election.cc:343] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.893603  4599 raft_consensus.cc:2468] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 0.
I20260709 12:25:16.893462  4716 consensus_queue.cc:260] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.895032  4638 leader_election.cc:304] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, a46ce53289054c3b8cd158d2285506ef; no voters: 481fa219fb0146dfac14a92f2cb8f134
I20260709 12:25:16.895877  4716 ts_tablet_manager.cc:1434] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:25:16.896265  4758 raft_consensus.cc:2804] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.896674  4758 raft_consensus.cc:493] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.896869  4716 tablet_bootstrap.cc:492] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef: Bootstrap starting.
I20260709 12:25:16.897043  4758 raft_consensus.cc:3060] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.903534  4716 tablet_bootstrap.cc:654] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.903869  4720 raft_consensus.cc:697] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 LEADER]: Becoming Leader. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:16.904816  4720 consensus_queue.cc:237] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.908845  4716 tablet_bootstrap.cc:492] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef: No bootstrap required, opened a new log
I20260709 12:25:16.909327  4716 ts_tablet_manager.cc:1403] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 12:25:16.891438  4717 raft_consensus.cc:359] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } } peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } }
I20260709 12:25:16.909915  4717 raft_consensus.cc:385] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.910180  4717 raft_consensus.cc:740] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.910871  4717 consensus_queue.cc:260] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } } peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } }
I20260709 12:25:16.912233  4716 raft_consensus.cc:359] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.912701  4717 ts_tablet_manager.cc:1434] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:25:16.912964  4716 raft_consensus.cc:385] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.913331  4716 raft_consensus.cc:740] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.913816  4717 tablet_bootstrap.cc:492] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134: Bootstrap starting.
I20260709 12:25:16.913585  4423 catalog_manager.cc:5697] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66). New cstate: current_term: 1 leader_uuid: "3a617de8b64b4d698b80dc8d986b5e75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:16.914184  4716 consensus_queue.cc:260] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.914327  4758 raft_consensus.cc:515] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.916412  4758 leader_election.cc:290] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317)
I20260709 12:25:16.917605  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec13febd4da419182593ae351aae577" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:16.918200  4599 raft_consensus.cc:3060] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.919237  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec13febd4da419182593ae351aae577" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:16.922035  4717 tablet_bootstrap.cc:654] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:16.922621  4640 leader_election.cc:343] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.924698  4740 raft_consensus.cc:493] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.925220  4740 raft_consensus.cc:515] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.925769  4599 raft_consensus.cc:2468] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 1.
I20260709 12:25:16.927018  4638 leader_election.cc:304] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, a46ce53289054c3b8cd158d2285506ef; no voters: 481fa219fb0146dfac14a92f2cb8f134
I20260709 12:25:16.925846  4421 catalog_manager.cc:5697] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 reported cstate change: term changed from 0 to 1, leader changed from <none> to 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "481fa219fb0146dfac14a92f2cb8f134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:16.928850  4716 ts_tablet_manager.cc:1434] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 12:25:16.929128  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38c80acfeef458fadf844c1e895d8f8" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134" is_pre_election: true
I20260709 12:25:16.929795  4716 tablet_bootstrap.cc:492] T 7861580b029e4832b72b175f808a0ca1 P a46ce53289054c3b8cd158d2285506ef: Bootstrap starting.
I20260709 12:25:16.929842  4526 raft_consensus.cc:2393] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a617de8b64b4d698b80dc8d986b5e75 in current term 1: Already voted for candidate a46ce53289054c3b8cd158d2285506ef in this term.
I20260709 12:25:16.936335  4716 tablet_bootstrap.cc:654] T 7861580b029e4832b72b175f808a0ca1 P a46ce53289054c3b8cd158d2285506ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.938218  4758 raft_consensus.cc:2804] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.938702  4758 raft_consensus.cc:697] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Becoming Leader. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Running, Role: LEADER
I20260709 12:25:16.939512  4758 consensus_queue.cc:237] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.941035  4673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38c80acfeef458fadf844c1e895d8f8" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46ce53289054c3b8cd158d2285506ef" is_pre_election: true
I20260709 12:25:16.942703  4566 leader_election.cc:304] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75; no voters: 481fa219fb0146dfac14a92f2cb8f134, a46ce53289054c3b8cd158d2285506ef
I20260709 12:25:16.943817  4724 raft_consensus.cc:3060] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.946307  4740 leader_election.cc:290] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:16.937301  4420 catalog_manager.cc:5697] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef reported cstate change: term changed from 0 to 1, leader changed from <none> to a46ce53289054c3b8cd158d2285506ef (127.3.200.67). New cstate: current_term: 1 leader_uuid: "a46ce53289054c3b8cd158d2285506ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.962735  4724 raft_consensus.cc:2749] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:16.970912  4717 tablet_bootstrap.cc:492] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134: No bootstrap required, opened a new log
I20260709 12:25:16.971230  4716 tablet_bootstrap.cc:492] T 7861580b029e4832b72b175f808a0ca1 P a46ce53289054c3b8cd158d2285506ef: No bootstrap required, opened a new log
I20260709 12:25:16.971387  4717 ts_tablet_manager.cc:1403] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134: Time spent bootstrapping tablet: real 0.058s	user 0.023s	sys 0.018s
I20260709 12:25:16.971665  4716 ts_tablet_manager.cc:1403] T 7861580b029e4832b72b175f808a0ca1 P a46ce53289054c3b8cd158d2285506ef: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.020s
I20260709 12:25:16.974633  4717 raft_consensus.cc:359] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.974635  4716 raft_consensus.cc:359] T 7861580b029e4832b72b175f808a0ca1 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.975208  4717 raft_consensus.cc:385] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.975433  4716 raft_consensus.cc:385] T 7861580b029e4832b72b175f808a0ca1 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.975488  4717 raft_consensus.cc:740] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.975903  4716 raft_consensus.cc:740] T 7861580b029e4832b72b175f808a0ca1 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.976414  4717 consensus_queue.cc:260] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.976656  4716 consensus_queue.cc:260] T 7861580b029e4832b72b175f808a0ca1 P a46ce53289054c3b8cd158d2285506ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.978334  4717 ts_tablet_manager.cc:1434] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:16.978729  4716 ts_tablet_manager.cc:1434] T 7861580b029e4832b72b175f808a0ca1 P a46ce53289054c3b8cd158d2285506ef: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:16.979601  4716 tablet_bootstrap.cc:492] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef: Bootstrap starting.
I20260709 12:25:16.979744  4717 tablet_bootstrap.cc:492] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134: Bootstrap starting.
I20260709 12:25:16.983279  4420 catalog_manager.cc:5697] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef reported cstate change: term changed from 0 to 1, leader changed from <none> to a46ce53289054c3b8cd158d2285506ef (127.3.200.67). New cstate: current_term: 1 leader_uuid: "a46ce53289054c3b8cd158d2285506ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.985396  4716 tablet_bootstrap.cc:654] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.985711  4717 tablet_bootstrap.cc:654] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.995306  4716 tablet_bootstrap.cc:492] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef: No bootstrap required, opened a new log
I20260709 12:25:16.995749  4716 ts_tablet_manager.cc:1403] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 12:25:16.996678  4717 tablet_bootstrap.cc:492] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134: No bootstrap required, opened a new log
I20260709 12:25:16.997087  4717 ts_tablet_manager.cc:1403] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:25:16.998312  4716 raft_consensus.cc:359] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.998991  4716 raft_consensus.cc:385] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.999265  4716 raft_consensus.cc:740] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.999626  4717 raft_consensus.cc:359] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:16.999902  4716 consensus_queue.cc:260] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.000278  4717 raft_consensus.cc:385] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.000715  4717 raft_consensus.cc:740] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.001392  4717 consensus_queue.cc:260] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.001951  4716 ts_tablet_manager.cc:1434] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:17.003635  4717 ts_tablet_manager.cc:1434] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:25:17.004446  4717 tablet_bootstrap.cc:492] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134: Bootstrap starting.
I20260709 12:25:17.009071  4717 tablet_bootstrap.cc:654] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:17.014079  4717 tablet_bootstrap.cc:492] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134: No bootstrap required, opened a new log
I20260709 12:25:17.014503  4717 ts_tablet_manager.cc:1403] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:25:17.016508  4717 raft_consensus.cc:359] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.017036  4717 raft_consensus.cc:385] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.017256  4717 raft_consensus.cc:740] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.017745  4717 consensus_queue.cc:260] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.019351  4717 ts_tablet_manager.cc:1434] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:17.028445  4720 raft_consensus.cc:493] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.029053  4720 raft_consensus.cc:515] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } } peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } }
I20260709 12:25:17.030790  4720 leader_election.cc:290] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:17.031406  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61866bd2197541018e7751ff916bd471" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75" is_pre_election: true
I20260709 12:25:17.031788  4673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61866bd2197541018e7751ff916bd471" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46ce53289054c3b8cd158d2285506ef" is_pre_election: true
I20260709 12:25:17.032068  4599 raft_consensus.cc:2393] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 481fa219fb0146dfac14a92f2cb8f134 in current term 1: Already voted for candidate a46ce53289054c3b8cd158d2285506ef in this term.
I20260709 12:25:17.033051  4491 leader_election.cc:304] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 481fa219fb0146dfac14a92f2cb8f134; no voters: 3a617de8b64b4d698b80dc8d986b5e75, a46ce53289054c3b8cd158d2285506ef
I20260709 12:25:17.033727  4720 raft_consensus.cc:3060] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.038266  4720 raft_consensus.cc:2749] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:17.080209  4720 raft_consensus.cc:493] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.080713  4720 raft_consensus.cc:515] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.082911  4720 leader_election.cc:290] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:17.083310  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec13febd4da419182593ae351aae577" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75" is_pre_election: true
I20260709 12:25:17.083523  4673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec13febd4da419182593ae351aae577" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46ce53289054c3b8cd158d2285506ef" is_pre_election: true
I20260709 12:25:17.084039  4599 raft_consensus.cc:2393] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 481fa219fb0146dfac14a92f2cb8f134 in current term 1: Already voted for candidate a46ce53289054c3b8cd158d2285506ef in this term.
I20260709 12:25:17.084929  4489 leader_election.cc:304] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 481fa219fb0146dfac14a92f2cb8f134; no voters: 3a617de8b64b4d698b80dc8d986b5e75, a46ce53289054c3b8cd158d2285506ef
I20260709 12:25:17.085624  4720 raft_consensus.cc:3060] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.090268  4720 raft_consensus.cc:2749] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:17.118999  4758 consensus_queue.cc:1048] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.131179  4758 consensus_queue.cc:1048] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:25:17.151602  4701 tablet.cc:2406] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:17.208276  4724 consensus_queue.cc:1048] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.213356  4724 raft_consensus.cc:493] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.214031  4724 raft_consensus.cc:515] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.216037  4724 leader_election.cc:290] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:17.219260  4525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57692562c3c94894afe825af6d77fe58" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134" is_pre_election: true
I20260709 12:25:17.219532  4673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57692562c3c94894afe825af6d77fe58" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46ce53289054c3b8cd158d2285506ef" is_pre_election: true
I20260709 12:25:17.219926  4674 raft_consensus.cc:3060] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.219993  4525 raft_consensus.cc:2468] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 0.
I20260709 12:25:17.220216  4673 raft_consensus.cc:2468] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 0.
I20260709 12:25:17.221693  4566 leader_election.cc:304] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: 
I20260709 12:25:17.222533  4724 raft_consensus.cc:2804] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:17.222954  4724 raft_consensus.cc:493] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.223363  4724 raft_consensus.cc:3060] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.230180  4751 consensus_queue.cc:1048] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:17.230127  4724 raft_consensus.cc:515] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.232004  4724 leader_election.cc:290] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:17.232755  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57692562c3c94894afe825af6d77fe58" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:17.233165  4673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57692562c3c94894afe825af6d77fe58" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:17.233369  4526 raft_consensus.cc:3060] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.233721  4673 raft_consensus.cc:3060] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.240666  4673 raft_consensus.cc:2468] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 1.
I20260709 12:25:17.240666  4526 raft_consensus.cc:2468] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 1.
I20260709 12:25:17.241932  4566 leader_election.cc:304] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, a46ce53289054c3b8cd158d2285506ef; no voters: 
I20260709 12:25:17.242717  4724 raft_consensus.cc:2804] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:17.243361  4724 raft_consensus.cc:697] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 LEADER]: Becoming Leader. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Running, Role: LEADER
I20260709 12:25:17.244017  4724 consensus_queue.cc:237] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.251811  4673 raft_consensus.cc:3060] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.252107  4758 consensus_queue.cc:1048] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.252526  4420 catalog_manager.cc:5697] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66). New cstate: current_term: 1 leader_uuid: "3a617de8b64b4d698b80dc8d986b5e75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.257216  4758 consensus_queue.cc:1048] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.261001  4724 consensus_queue.cc:1048] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.262159  4758 raft_consensus.cc:493] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.262786  4758 raft_consensus.cc:515] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.266932  4600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eab1ee01b0447f187f838bad18a5422" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75" is_pre_election: true
I20260709 12:25:17.268008  4600 raft_consensus.cc:2393] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46ce53289054c3b8cd158d2285506ef in current term 1: Already voted for candidate 481fa219fb0146dfac14a92f2cb8f134 in this term.
I20260709 12:25:17.274299  4524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eab1ee01b0447f187f838bad18a5422" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "481fa219fb0146dfac14a92f2cb8f134" is_pre_election: true
I20260709 12:25:17.276415  4640 leader_election.cc:304] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46ce53289054c3b8cd158d2285506ef; no voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134
I20260709 12:25:17.277222  4760 raft_consensus.cc:3060] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.277990  4758 leader_election.cc:290] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317)
I20260709 12:25:17.284482  4760 raft_consensus.cc:2749] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:17.286827  4758 consensus_queue.cc:1048] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.290839  4724 consensus_queue.cc:1048] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.298501  4723 consensus_queue.cc:1048] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.373451  4720 consensus_queue.cc:1048] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.378181  4720 raft_consensus.cc:493] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.378697  4720 raft_consensus.cc:515] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.380865  4720 leader_election.cc:290] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:17.383983  4600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7861580b029e4832b72b175f808a0ca1" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75" is_pre_election: true
I20260709 12:25:17.384187  4673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7861580b029e4832b72b175f808a0ca1" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46ce53289054c3b8cd158d2285506ef" is_pre_election: true
I20260709 12:25:17.384775  4673 raft_consensus.cc:2468] T 7861580b029e4832b72b175f808a0ca1 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 0.
I20260709 12:25:17.384778  4600 raft_consensus.cc:2468] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 0.
I20260709 12:25:17.387030  4489 leader_election.cc:304] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: 
I20260709 12:25:17.387852  4795 raft_consensus.cc:2804] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:17.388509  4769 consensus_queue.cc:1048] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:17.389160  4723 consensus_queue.cc:1048] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.390316  4795 raft_consensus.cc:493] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.390799  4795 raft_consensus.cc:3060] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.402135  4795 raft_consensus.cc:515] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.406255  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7861580b029e4832b72b175f808a0ca1" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:17.406366  4673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7861580b029e4832b72b175f808a0ca1" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:17.406879  4599 raft_consensus.cc:3060] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.406961  4673 raft_consensus.cc:3060] T 7861580b029e4832b72b175f808a0ca1 P a46ce53289054c3b8cd158d2285506ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.407768  4795 leader_election.cc:290] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 1 election: Requested vote from peers 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:17.416179  4599 raft_consensus.cc:2468] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 1.
I20260709 12:25:17.417486  4489 leader_election.cc:304] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: 
I20260709 12:25:17.418401  4769 raft_consensus.cc:2804] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:17.419015  4673 raft_consensus.cc:2468] T 7861580b029e4832b72b175f808a0ca1 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 1.
I20260709 12:25:17.419436  4769 raft_consensus.cc:697] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 LEADER]: Becoming Leader. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:17.421231  4758 consensus_queue.cc:1048] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.421224  4769 consensus_queue.cc:237] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.436820  4421 catalog_manager.cc:5697] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 reported cstate change: term changed from 0 to 1, leader changed from <none> to 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "481fa219fb0146dfac14a92f2cb8f134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.483127  4758 consensus_queue.cc:1048] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.493728  4758 consensus_queue.cc:1048] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.775075  4673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61866bd2197541018e7751ff916bd471"
dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
mode: GRACEFUL
new_leader_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:25:17.775661  4673 raft_consensus.cc:606] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Received request to transfer leadership to TS 481fa219fb0146dfac14a92f2cb8f134
I20260709 12:25:17.789364  4599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57692562c3c94894afe825af6d77fe58"
dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
mode: GRACEFUL
new_leader_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:59170
I20260709 12:25:17.789845  4599 raft_consensus.cc:606] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 LEADER]: Received request to transfer leadership to TS 481fa219fb0146dfac14a92f2cb8f134
I20260709 12:25:17.794775  4673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a38c80acfeef458fadf844c1e895d8f8"
dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
mode: GRACEFUL
new_leader_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:25:17.795288  4673 raft_consensus.cc:606] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Received request to transfer leadership to TS 481fa219fb0146dfac14a92f2cb8f134
I20260709 12:25:17.800061  4599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5"
dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
mode: GRACEFUL
new_leader_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:59170
I20260709 12:25:17.800611  4599 raft_consensus.cc:606] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 LEADER]: Received request to transfer leadership to TS 481fa219fb0146dfac14a92f2cb8f134
I20260709 12:25:17.805276  4599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181"
dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
mode: GRACEFUL
new_leader_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:59170
I20260709 12:25:17.805737  4599 raft_consensus.cc:606] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 LEADER]: Received request to transfer leadership to TS 481fa219fb0146dfac14a92f2cb8f134
I20260709 12:25:17.810338  4673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cac76e593794fce9cf61281bee155ef"
dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
mode: GRACEFUL
new_leader_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:25:17.810828  4673 raft_consensus.cc:606] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Received request to transfer leadership to TS 3a617de8b64b4d698b80dc8d986b5e75
I20260709 12:25:17.818739  4724 consensus_queue.cc:1048] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.819175  4758 raft_consensus.cc:993] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef: : Instructing follower 3a617de8b64b4d698b80dc8d986b5e75 to start an election
I20260709 12:25:17.819592  4723 raft_consensus.cc:1081] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Signalling peer 3a617de8b64b4d698b80dc8d986b5e75 to start an election
I20260709 12:25:17.821288  4599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cac76e593794fce9cf61281bee155ef"
dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
 from {username='slave'} at 127.0.0.1:36292
I20260709 12:25:17.821871  4599 raft_consensus.cc:493] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:17.822373  4599 raft_consensus.cc:3060] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.828133  4751 raft_consensus.cc:993] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75: : Instructing follower 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:17.828632  4751 raft_consensus.cc:1081] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 LEADER]: Signalling peer 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:17.830614  4526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9eab1ee01b0447f187f838bad18a5422"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
mode: GRACEFUL
new_leader_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
 from {username='slave'} at 127.0.0.1:40844
I20260709 12:25:17.830798  4599 raft_consensus.cc:515] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.831214  4526 raft_consensus.cc:606] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 LEADER]: Received request to transfer leadership to TS 3a617de8b64b4d698b80dc8d986b5e75
I20260709 12:25:17.830813  4524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57692562c3c94894afe825af6d77fe58"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:37276
I20260709 12:25:17.834668  4524 raft_consensus.cc:493] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:17.835155  4524 raft_consensus.cc:3060] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.836539  4674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac76e593794fce9cf61281bee155ef" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:17.837731  4674 raft_consensus.cc:3055] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:17.838059  4674 raft_consensus.cc:740] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Running, Role: LEADER
I20260709 12:25:17.837956  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac76e593794fce9cf61281bee155ef" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:17.838696  4526 raft_consensus.cc:3060] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.838969  4674 consensus_queue.cc:260] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.840093  4674 raft_consensus.cc:3060] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.843386  4673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aec13febd4da419182593ae351aae577"
dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
mode: GRACEFUL
new_leader_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:25:17.843993  4673 raft_consensus.cc:606] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Received request to transfer leadership to TS 3a617de8b64b4d698b80dc8d986b5e75
I20260709 12:25:17.844376  4720 raft_consensus.cc:993] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134: : Instructing follower 3a617de8b64b4d698b80dc8d986b5e75 to start an election
I20260709 12:25:17.844802  4720 raft_consensus.cc:1081] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 LEADER]: Signalling peer 3a617de8b64b4d698b80dc8d986b5e75 to start an election
I20260709 12:25:17.846978  4795 consensus_queue.cc:1048] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.848428  4526 raft_consensus.cc:2468] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 2.
I20260709 12:25:17.848822  4751 consensus_queue.cc:1048] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.833514  4599 leader_election.cc:290] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 2 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:17.850404  4526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7861580b029e4832b72b175f808a0ca1"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
mode: GRACEFUL
new_leader_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
 from {username='slave'} at 127.0.0.1:40844
I20260709 12:25:17.851012  4600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9eab1ee01b0447f187f838bad18a5422"
dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
 from {username='slave'} at 127.0.0.1:59162
I20260709 12:25:17.851444  4674 raft_consensus.cc:2468] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 2.
I20260709 12:25:17.851544  4600 raft_consensus.cc:493] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:17.851986  4600 raft_consensus.cc:3060] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.853761  4566 leader_election.cc:304] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: 
I20260709 12:25:17.858430  4751 raft_consensus.cc:2804] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:17.858907  4751 raft_consensus.cc:697] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 LEADER]: Becoming Leader. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Running, Role: LEADER
I20260709 12:25:17.859578  4600 raft_consensus.cc:515] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.859754  4751 consensus_queue.cc:237] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.850999  4526 raft_consensus.cc:606] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 LEADER]: Received request to transfer leadership to TS 3a617de8b64b4d698b80dc8d986b5e75
I20260709 12:25:17.863840  4600 leader_election.cc:290] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 2 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:17.866461  4769 raft_consensus.cc:993] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134: : Instructing follower 3a617de8b64b4d698b80dc8d986b5e75 to start an election
I20260709 12:25:17.866904  4769 raft_consensus.cc:1081] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 LEADER]: Signalling peer 3a617de8b64b4d698b80dc8d986b5e75 to start an election
I20260709 12:25:17.867215  4792 raft_consensus.cc:993] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef: : Instructing follower 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:17.867767  4792 raft_consensus.cc:1081] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Signalling peer 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:17.871670  4522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a38c80acfeef458fadf844c1e895d8f8"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:37260
I20260709 12:25:17.872283  4522 raft_consensus.cc:493] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:17.877136  4789 raft_consensus.cc:993] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75: : Instructing follower 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:17.872655  4522 raft_consensus.cc:3060] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.877578  4789 raft_consensus.cc:1081] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 LEADER]: Signalling peer 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:17.878640  4795 consensus_queue.cc:1048] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.881527  4526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:37276
I20260709 12:25:17.872536  4421 catalog_manager.cc:5697] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 reported cstate change: term changed from 1 to 2, leader changed from a46ce53289054c3b8cd158d2285506ef (127.3.200.67) to 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66). New cstate: current_term: 2 leader_uuid: "3a617de8b64b4d698b80dc8d986b5e75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.882076  4526 raft_consensus.cc:493] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:17.882491  4526 raft_consensus.cc:3060] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.873328  4523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eab1ee01b0447f187f838bad18a5422" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:17.889706  4523 raft_consensus.cc:3055] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:17.890070  4523 raft_consensus.cc:740] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:17.873962  4674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eab1ee01b0447f187f838bad18a5422" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:17.890713  4674 raft_consensus.cc:3060] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.891033  4523 consensus_queue.cc:260] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.892336  4523 raft_consensus.cc:3060] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.872941  4524 raft_consensus.cc:515] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.902860  4674 raft_consensus.cc:2468] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 2.
I20260709 12:25:17.898772  4526 raft_consensus.cc:515] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.905984  4526 leader_election.cc:290] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 2 election: Requested vote from peers 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:17.907498  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:17.907939  4524 leader_election.cc:290] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 2 election: Requested vote from peers 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:17.908093  4675 raft_consensus.cc:3060] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.910045  4601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:17.910653  4601 raft_consensus.cc:3055] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:17.910970  4601 raft_consensus.cc:740] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Running, Role: LEADER
I20260709 12:25:17.912914  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57692562c3c94894afe825af6d77fe58" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:17.913528  4599 raft_consensus.cc:3055] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:17.913913  4599 raft_consensus.cc:740] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Running, Role: LEADER
I20260709 12:25:17.874331  4600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7861580b029e4832b72b175f808a0ca1"
dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
 from {username='slave'} at 127.0.0.1:59162
I20260709 12:25:17.914788  4599 consensus_queue.cc:260] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.915478  4600 raft_consensus.cc:493] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:17.915880  4600 raft_consensus.cc:3060] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.916038  4599 raft_consensus.cc:3060] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.911815  4601 consensus_queue.cc:260] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.915192  4566 leader_election.cc:304] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, a46ce53289054c3b8cd158d2285506ef; no voters: 
I20260709 12:25:17.924422  4807 raft_consensus.cc:2804] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:17.924623  4601 raft_consensus.cc:3060] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.924942  4807 raft_consensus.cc:697] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 LEADER]: Becoming Leader. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Running, Role: LEADER
I20260709 12:25:17.889285  4522 raft_consensus.cc:515] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.921590  4523 raft_consensus.cc:2468] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 2.
I20260709 12:25:17.926704  4807 consensus_queue.cc:237] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.923753  4599 raft_consensus.cc:2468] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 2.
I20260709 12:25:17.932752  4489 leader_election.cc:304] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: 
I20260709 12:25:17.933670  4769 raft_consensus.cc:2804] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:17.934161  4769 raft_consensus.cc:697] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Becoming Leader. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:17.934973  4769 consensus_queue.cc:237] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.936656  4522 leader_election.cc:290] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 2 election: Requested vote from peers 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:17.939260  4421 catalog_manager.cc:5697] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 reported cstate change: term changed from 1 to 2, leader changed from 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65) to 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66). New cstate: current_term: 2 leader_uuid: "3a617de8b64b4d698b80dc8d986b5e75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.940519  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38c80acfeef458fadf844c1e895d8f8" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:17.942914  4599 raft_consensus.cc:3060] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.942466  4420 catalog_manager.cc:5697] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 reported cstate change: term changed from 1 to 2, leader changed from 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66) to 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65). New cstate: current_term: 2 leader_uuid: "481fa219fb0146dfac14a92f2cb8f134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.946970  4672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38c80acfeef458fadf844c1e895d8f8" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:17.947595  4672 raft_consensus.cc:3055] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:17.940070  4675 raft_consensus.cc:2468] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 2.
I20260709 12:25:17.947906  4672 raft_consensus.cc:740] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Running, Role: LEADER
I20260709 12:25:17.948540  4601 raft_consensus.cc:2468] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 2.
I20260709 12:25:17.947861  4674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57692562c3c94894afe825af6d77fe58" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:17.950153  4489 leader_election.cc:304] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: 
I20260709 12:25:17.951205  4769 raft_consensus.cc:2804] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:17.951574  4769 raft_consensus.cc:697] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Becoming Leader. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:17.951444  4600 raft_consensus.cc:515] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.952291  4769 consensus_queue.cc:237] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.953655  4674 raft_consensus.cc:3060] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.949050  4672 consensus_queue.cc:260] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.958237  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7861580b029e4832b72b175f808a0ca1" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:17.958885  4522 raft_consensus.cc:3055] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:17.959214  4522 raft_consensus.cc:740] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:17.961450  4522 consensus_queue.cc:260] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.962293  4672 raft_consensus.cc:3060] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.962870  4522 raft_consensus.cc:3060] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.963603  4674 raft_consensus.cc:2468] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 2.
I20260709 12:25:17.962329  4600 leader_election.cc:290] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 2 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:17.964759  4423 catalog_manager.cc:5697] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 reported cstate change: term changed from 1 to 2, leader changed from 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66) to 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65). New cstate: current_term: 2 leader_uuid: "481fa219fb0146dfac14a92f2cb8f134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.967758  4599 raft_consensus.cc:2468] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 2.
I20260709 12:25:17.968719  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7861580b029e4832b72b175f808a0ca1" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:17.968921  4489 leader_election.cc:304] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: 
I20260709 12:25:17.969302  4675 raft_consensus.cc:3060] T 7861580b029e4832b72b175f808a0ca1 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:17.969688  4769 raft_consensus.cc:2804] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:17.970069  4522 raft_consensus.cc:2468] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 2.
I20260709 12:25:17.970162  4769 raft_consensus.cc:697] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Becoming Leader. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:17.971167  4769 consensus_queue.cc:237] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.975016  4566 leader_election.cc:304] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: 
I20260709 12:25:17.975835  4807 raft_consensus.cc:2804] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:17.976351  4807 raft_consensus.cc:697] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 LEADER]: Becoming Leader. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Running, Role: LEADER
I20260709 12:25:17.977845  4807 consensus_queue.cc:237] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:17.984040  4672 raft_consensus.cc:2468] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 2.
I20260709 12:25:17.983608  4423 catalog_manager.cc:5697] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 reported cstate change: term changed from 1 to 2, leader changed from a46ce53289054c3b8cd158d2285506ef (127.3.200.67) to 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65). New cstate: current_term: 2 leader_uuid: "481fa219fb0146dfac14a92f2cb8f134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.976261  4675 raft_consensus.cc:2468] T 7861580b029e4832b72b175f808a0ca1 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 2.
I20260709 12:25:17.985183  4420 catalog_manager.cc:5697] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 reported cstate change: term changed from 1 to 2, leader changed from 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65) to 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66). New cstate: current_term: 2 leader_uuid: "3a617de8b64b4d698b80dc8d986b5e75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:18.006462  4723 raft_consensus.cc:993] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef: : Instructing follower 3a617de8b64b4d698b80dc8d986b5e75 to start an election
I20260709 12:25:18.006922  4758 raft_consensus.cc:1081] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Signalling peer 3a617de8b64b4d698b80dc8d986b5e75 to start an election
I20260709 12:25:18.008466  4599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aec13febd4da419182593ae351aae577"
dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
 from {username='slave'} at 127.0.0.1:36292
I20260709 12:25:18.009073  4599 raft_consensus.cc:493] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:18.009393  4599 raft_consensus.cc:3060] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:18.014647  4599 raft_consensus.cc:515] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:18.016337  4599 leader_election.cc:290] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 2 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:18.017434  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec13febd4da419182593ae351aae577" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:18.017740  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec13febd4da419182593ae351aae577" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:18.018018  4522 raft_consensus.cc:3060] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:18.018338  4675 raft_consensus.cc:3055] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:18.018641  4675 raft_consensus.cc:740] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Running, Role: LEADER
I20260709 12:25:18.019363  4675 consensus_queue.cc:260] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:18.020519  4675 raft_consensus.cc:3060] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:18.023840  4522 raft_consensus.cc:2468] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 2.
I20260709 12:25:18.025038  4566 leader_election.cc:304] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: 
I20260709 12:25:18.025835  4807 raft_consensus.cc:2804] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:18.026307  4807 raft_consensus.cc:697] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 LEADER]: Becoming Leader. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Running, Role: LEADER
I20260709 12:25:18.026774  4675 raft_consensus.cc:2468] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 2.
I20260709 12:25:18.027199  4807 consensus_queue.cc:237] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:18.033634  4420 catalog_manager.cc:5697] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 reported cstate change: term changed from 1 to 2, leader changed from a46ce53289054c3b8cd158d2285506ef (127.3.200.67) to 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66). New cstate: current_term: 2 leader_uuid: "3a617de8b64b4d698b80dc8d986b5e75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:18.107316  4723 raft_consensus.cc:993] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef: : Instructing follower 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:18.107826  4758 raft_consensus.cc:1081] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Signalling peer 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:18.109479  4523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61866bd2197541018e7751ff916bd471"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:37260
I20260709 12:25:18.110016  4523 raft_consensus.cc:493] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:18.110323  4523 raft_consensus.cc:3060] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:18.115240  4523 raft_consensus.cc:515] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } } peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } }
I20260709 12:25:18.117473  4523 leader_election.cc:290] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 2 election: Requested vote from peers 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:18.118150  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61866bd2197541018e7751ff916bd471" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:18.118453  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61866bd2197541018e7751ff916bd471" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:18.118765  4599 raft_consensus.cc:3060] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:18.119016  4675 raft_consensus.cc:3055] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:18.119341  4675 raft_consensus.cc:740] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Running, Role: LEADER
I20260709 12:25:18.120150  4675 consensus_queue.cc:260] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } } peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } }
I20260709 12:25:18.121394  4675 raft_consensus.cc:3060] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:18.125659  4599 raft_consensus.cc:2468] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 2.
I20260709 12:25:18.127018  4489 leader_election.cc:304] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: 
I20260709 12:25:18.127794  4795 raft_consensus.cc:2804] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:18.128029  4675 raft_consensus.cc:2468] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 2.
I20260709 12:25:18.128270  4795 raft_consensus.cc:697] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Becoming Leader. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:18.129145  4795 consensus_queue.cc:237] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } } peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } }
I20260709 12:25:18.135527  4420 catalog_manager.cc:5697] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 reported cstate change: term changed from 1 to 2, leader changed from a46ce53289054c3b8cd158d2285506ef (127.3.200.67) to 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65). New cstate: current_term: 2 leader_uuid: "481fa219fb0146dfac14a92f2cb8f134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:18.214336  4751 raft_consensus.cc:993] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75: : Instructing follower 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:18.214808  4807 raft_consensus.cc:1081] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 LEADER]: Signalling peer 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:18.216383  4523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:37276
I20260709 12:25:18.216928  4523 raft_consensus.cc:493] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:18.217255  4523 raft_consensus.cc:3060] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:18.222158  4523 raft_consensus.cc:515] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:18.223883  4523 leader_election.cc:290] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 2 election: Requested vote from peers 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:18.224967  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:18.225005  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:18.225517  4675 raft_consensus.cc:3060] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:18.226030  4599 raft_consensus.cc:3055] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:18.226398  4599 raft_consensus.cc:740] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Running, Role: LEADER
I20260709 12:25:18.227331  4599 consensus_queue.cc:260] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:18.228350  4599 raft_consensus.cc:3060] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:18.231067  4675 raft_consensus.cc:2468] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 2.
I20260709 12:25:18.231730  4672 raft_consensus.cc:1240] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Rejecting Update request from peer 3a617de8b64b4d698b80dc8d986b5e75 for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:18.232360  4491 leader_election.cc:304] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481fa219fb0146dfac14a92f2cb8f134, a46ce53289054c3b8cd158d2285506ef; no voters: 
I20260709 12:25:18.233213  4795 raft_consensus.cc:2804] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:18.233711  4795 raft_consensus.cc:697] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Becoming Leader. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:18.234913  4599 raft_consensus.cc:2468] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 2.
I20260709 12:25:18.234555  4795 consensus_queue.cc:237] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:18.241883  4420 catalog_manager.cc:5697] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 reported cstate change: term changed from 1 to 2, leader changed from 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66) to 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65). New cstate: current_term: 2 leader_uuid: "481fa219fb0146dfac14a92f2cb8f134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:18.315812  4672 raft_consensus.cc:1275] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Refusing update from remote peer 3a617de8b64b4d698b80dc8d986b5e75: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.317410  4807 consensus_queue.cc:1048] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.324920  4523 raft_consensus.cc:1275] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Refusing update from remote peer 3a617de8b64b4d698b80dc8d986b5e75: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.326285  4724 consensus_queue.cc:1048] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.345485  4672 raft_consensus.cc:1275] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.346753  4795 consensus_queue.cc:1048] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.354522  4599 raft_consensus.cc:1275] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.355978  4720 consensus_queue.cc:1048] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.377187  4672 raft_consensus.cc:1275] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Refusing update from remote peer 3a617de8b64b4d698b80dc8d986b5e75: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.378603  4724 consensus_queue.cc:1048] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.387238  4523 raft_consensus.cc:1275] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Refusing update from remote peer 3a617de8b64b4d698b80dc8d986b5e75: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.388700  4724 consensus_queue.cc:1048] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.418691  4599 raft_consensus.cc:1275] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.420156  4795 consensus_queue.cc:1048] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.428834  4672 raft_consensus.cc:1275] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.434702  4720 consensus_queue.cc:1048] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.474792  4672 raft_consensus.cc:1275] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.475965  4599 raft_consensus.cc:1275] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.476171  4720 consensus_queue.cc:1048] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.477255  4769 consensus_queue.cc:1048] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.497782  4672 raft_consensus.cc:1275] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Refusing update from remote peer 3a617de8b64b4d698b80dc8d986b5e75: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.499063  4724 consensus_queue.cc:1048] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.507814  4523 raft_consensus.cc:1275] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Refusing update from remote peer 3a617de8b64b4d698b80dc8d986b5e75: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.509945  4789 consensus_queue.cc:1048] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.539011  4523 raft_consensus.cc:1275] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Refusing update from remote peer 3a617de8b64b4d698b80dc8d986b5e75: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.540364  4751 consensus_queue.cc:1048] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.548692  4672 raft_consensus.cc:1275] T 7861580b029e4832b72b175f808a0ca1 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Refusing update from remote peer 3a617de8b64b4d698b80dc8d986b5e75: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.550632  4751 consensus_queue.cc:1048] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.597204  4672 raft_consensus.cc:1275] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.598484  4720 consensus_queue.cc:1048] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.607401  4599 raft_consensus.cc:1275] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.609267  4769 consensus_queue.cc:1048] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.635106  4672 raft_consensus.cc:1275] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.636281  4769 consensus_queue.cc:1048] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:18.644677  4599 raft_consensus.cc:1275] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:18.646477  4795 consensus_queue.cc:1048] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:20.904454  3873 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:25:20.905220  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:20.925475  4523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
mode: GRACEFUL
new_leader_uuid: "a46ce53289054c3b8cd158d2285506ef"
 from {username='slave'} at 127.0.0.1:40854
I20260709 12:25:20.926015  4523 raft_consensus.cc:606] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Received request to transfer leadership to TS a46ce53289054c3b8cd158d2285506ef
I20260709 12:25:20.928448  4523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
mode: GRACEFUL
new_leader_uuid: "a46ce53289054c3b8cd158d2285506ef"
 from {username='slave'} at 127.0.0.1:40854
I20260709 12:25:20.929028  4523 raft_consensus.cc:606] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Received request to transfer leadership to TS a46ce53289054c3b8cd158d2285506ef
I20260709 12:25:20.930114  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:20.930668  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:21.053304  4827 raft_consensus.cc:993] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134: : Instructing follower a46ce53289054c3b8cd158d2285506ef to start an election
I20260709 12:25:21.053948  4826 raft_consensus.cc:1081] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Signalling peer a46ce53289054c3b8cd158d2285506ef to start an election
I20260709 12:25:21.055985  4675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5"
dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
 from {username='slave'} at 127.0.0.1:40628
I20260709 12:25:21.056438  4675 raft_consensus.cc:493] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:21.056726  4675 raft_consensus.cc:3060] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:21.061610  4675 raft_consensus.cc:515] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:21.063264  4675 leader_election.cc:290] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 3 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317)
I20260709 12:25:21.064002  4523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:21.064347  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:21.064669  4523 raft_consensus.cc:3055] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:21.064919  4599 raft_consensus.cc:3060] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:21.065053  4523 raft_consensus.cc:740] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:21.065896  4523 consensus_queue.cc:260] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:21.066780  4523 raft_consensus.cc:3060] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:21.069815  4599 raft_consensus.cc:2468] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 3.
I20260709 12:25:21.070950  4638 leader_election.cc:304] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, a46ce53289054c3b8cd158d2285506ef; no voters: 
I20260709 12:25:21.071635  4825 raft_consensus.cc:2804] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:21.072889  4825 raft_consensus.cc:697] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 3 LEADER]: Becoming Leader. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Running, Role: LEADER
I20260709 12:25:21.072968  4523 raft_consensus.cc:2468] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 3.
I20260709 12:25:21.073800  4825 consensus_queue.cc:237] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:21.082173  4420 catalog_manager.cc:5697] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef reported cstate change: term changed from 2 to 3, leader changed from 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65) to a46ce53289054c3b8cd158d2285506ef (127.3.200.67). New cstate: current_term: 3 leader_uuid: "a46ce53289054c3b8cd158d2285506ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:21.241753  4827 raft_consensus.cc:993] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134: : Instructing follower a46ce53289054c3b8cd158d2285506ef to start an election
I20260709 12:25:21.242231  4826 raft_consensus.cc:1081] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Signalling peer a46ce53289054c3b8cd158d2285506ef to start an election
I20260709 12:25:21.243813  4675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181"
dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
 from {username='slave'} at 127.0.0.1:40628
I20260709 12:25:21.244340  4675 raft_consensus.cc:493] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:21.244756  4675 raft_consensus.cc:3060] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:21.250418  4675 raft_consensus.cc:515] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:21.252527  4675 leader_election.cc:290] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 3 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317)
I20260709 12:25:21.252771  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:21.253080  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:21.253412  4522 raft_consensus.cc:3055] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:21.253568  4599 raft_consensus.cc:3060] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:21.253770  4522 raft_consensus.cc:740] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:21.254590  4522 consensus_queue.cc:260] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:21.255788  4522 raft_consensus.cc:3060] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:21.259999  4599 raft_consensus.cc:2468] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 3.
I20260709 12:25:21.261168  4638 leader_election.cc:304] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, a46ce53289054c3b8cd158d2285506ef; no voters: 
I20260709 12:25:21.261899  4825 raft_consensus.cc:2804] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:21.262145  4522 raft_consensus.cc:2468] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 3.
I20260709 12:25:21.262331  4825 raft_consensus.cc:697] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 3 LEADER]: Becoming Leader. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Running, Role: LEADER
I20260709 12:25:21.263231  4825 consensus_queue.cc:237] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:21.269675  4420 catalog_manager.cc:5697] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef reported cstate change: term changed from 2 to 3, leader changed from 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65) to a46ce53289054c3b8cd158d2285506ef (127.3.200.67). New cstate: current_term: 3 leader_uuid: "a46ce53289054c3b8cd158d2285506ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:21.570840  4599 raft_consensus.cc:1275] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Refusing update from remote peer a46ce53289054c3b8cd158d2285506ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:21.572227  4825 consensus_queue.cc:1048] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:21.583416  4522 raft_consensus.cc:1275] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Refusing update from remote peer a46ce53289054c3b8cd158d2285506ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:21.585260  4830 consensus_queue.cc:1048] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:21.667824  4599 raft_consensus.cc:1275] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Refusing update from remote peer a46ce53289054c3b8cd158d2285506ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:21.669018  4830 consensus_queue.cc:1048] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:21.677482  4522 raft_consensus.cc:1275] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Refusing update from remote peer a46ce53289054c3b8cd158d2285506ef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:21.679152  4839 consensus_queue.cc:1048] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:21.931597  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:21.938545  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:21.939045  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:22.940033  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:22.946002  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:22.946372  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:23.947361  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:23.952678  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:23.953063  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:24.954150  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:24.959708  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:24.960107  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:25.961129  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:25.967741  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:25.968176  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:26.969133  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:26.974459  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:26.974908  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:27.975831  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:27.981123  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:27.981590  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:28.982508  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:28.987995  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:28.988444  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:29.989382  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:29.995507  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:29.995957  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:31.028604  3873 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:25:31.041968  4675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5"
dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
mode: GRACEFUL
new_leader_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:25:31.042683  4675 raft_consensus.cc:606] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 3 LEADER]: Received request to transfer leadership to TS 481fa219fb0146dfac14a92f2cb8f134
I20260709 12:25:31.047874  4675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181"
dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
mode: GRACEFUL
new_leader_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:40644
I20260709 12:25:31.048343  4675 raft_consensus.cc:606] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 3 LEADER]: Received request to transfer leadership to TS 481fa219fb0146dfac14a92f2cb8f134
I20260709 12:25:31.053347  4600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cac76e593794fce9cf61281bee155ef"
dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
mode: GRACEFUL
new_leader_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:59170
I20260709 12:25:31.053843  4600 raft_consensus.cc:606] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 LEADER]: Received request to transfer leadership to TS 481fa219fb0146dfac14a92f2cb8f134
I20260709 12:25:31.059386  4600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9eab1ee01b0447f187f838bad18a5422"
dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
mode: GRACEFUL
new_leader_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:59170
I20260709 12:25:31.060009  4600 raft_consensus.cc:606] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 LEADER]: Received request to transfer leadership to TS 481fa219fb0146dfac14a92f2cb8f134
I20260709 12:25:31.065382  4600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aec13febd4da419182593ae351aae577"
dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
mode: GRACEFUL
new_leader_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:59170
I20260709 12:25:31.065965  4600 raft_consensus.cc:606] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 LEADER]: Received request to transfer leadership to TS 481fa219fb0146dfac14a92f2cb8f134
I20260709 12:25:31.206914  4751 raft_consensus.cc:993] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75: : Instructing follower 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:31.207333  4751 raft_consensus.cc:1081] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 LEADER]: Signalling peer 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:31.208868  4522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cac76e593794fce9cf61281bee155ef"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:37276
I20260709 12:25:31.209396  4522 raft_consensus.cc:493] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:31.209764  4522 raft_consensus.cc:3060] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:31.215767  4522 raft_consensus.cc:515] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:31.217533  4522 leader_election.cc:290] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 3 election: Requested vote from peers 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:31.218663  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac76e593794fce9cf61281bee155ef" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:31.218560  4600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac76e593794fce9cf61281bee155ef" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:31.219318  4675 raft_consensus.cc:3060] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:31.219416  4600 raft_consensus.cc:3055] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:31.219758  4600 raft_consensus.cc:740] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Running, Role: LEADER
I20260709 12:25:31.220822  4600 consensus_queue.cc:260] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:31.222180  4600 raft_consensus.cc:3060] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:31.226941  4675 raft_consensus.cc:2468] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 3.
I20260709 12:25:31.228384  4491 leader_election.cc:304] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481fa219fb0146dfac14a92f2cb8f134, a46ce53289054c3b8cd158d2285506ef; no voters: 
I20260709 12:25:31.229275  4847 raft_consensus.cc:2804] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:31.229308  4600 raft_consensus.cc:2468] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 3.
I20260709 12:25:31.230649  4847 raft_consensus.cc:697] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 3 LEADER]: Becoming Leader. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:31.231570  4847 consensus_queue.cc:237] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:31.239234  4420 catalog_manager.cc:5697] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 reported cstate change: term changed from 2 to 3, leader changed from 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66) to 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65). New cstate: current_term: 3 leader_uuid: "481fa219fb0146dfac14a92f2cb8f134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.331862  4846 raft_consensus.cc:993] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef: : Instructing follower 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:31.332377  4859 raft_consensus.cc:1081] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 3 LEADER]: Signalling peer 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:31.333904  4522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:37260
I20260709 12:25:31.334407  4522 raft_consensus.cc:493] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:31.334697  4522 raft_consensus.cc:3060] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:31.339709  4522 raft_consensus.cc:515] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:31.341455  4522 leader_election.cc:290] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 4 election: Requested vote from peers 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:31.342446  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:31.342396  4600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:31.343104  4675 raft_consensus.cc:3055] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:31.343127  4600 raft_consensus.cc:3060] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:31.343544  4675 raft_consensus.cc:740] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Running, Role: LEADER
I20260709 12:25:31.344321  4675 consensus_queue.cc:260] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:31.345590  4675 raft_consensus.cc:3060] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:31.350615  4600 raft_consensus.cc:2468] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 4.
I20260709 12:25:31.352057  4675 raft_consensus.cc:2468] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 4.
I20260709 12:25:31.352011  4489 leader_election.cc:304] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: 
I20260709 12:25:31.352957  4847 raft_consensus.cc:2804] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:31.353384  4847 raft_consensus.cc:697] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 4 LEADER]: Becoming Leader. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:31.354168  4847 consensus_queue.cc:237] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:31.360869  4420 catalog_manager.cc:5697] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 reported cstate change: term changed from 3 to 4, leader changed from a46ce53289054c3b8cd158d2285506ef (127.3.200.67) to 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65). New cstate: current_term: 4 leader_uuid: "481fa219fb0146dfac14a92f2cb8f134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.361847  4846 raft_consensus.cc:993] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef: : Instructing follower 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:31.362327  4846 raft_consensus.cc:1081] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 3 LEADER]: Signalling peer 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:31.364158  4523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:37260
I20260709 12:25:31.364727  4852 raft_consensus.cc:993] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75: : Instructing follower 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:31.364727  4523 raft_consensus.cc:493] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:31.365288  4523 raft_consensus.cc:3060] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:31.365969  4751 raft_consensus.cc:1081] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 LEADER]: Signalling peer 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:31.367533  4522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9eab1ee01b0447f187f838bad18a5422"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:37276
I20260709 12:25:31.368080  4522 raft_consensus.cc:493] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:31.368467  4522 raft_consensus.cc:3060] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:31.373881  4852 raft_consensus.cc:993] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75: : Instructing follower 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:31.373956  4523 raft_consensus.cc:515] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:31.374356  4751 raft_consensus.cc:1081] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 LEADER]: Signalling peer 481fa219fb0146dfac14a92f2cb8f134 to start an election
I20260709 12:25:31.375861  4526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aec13febd4da419182593ae351aae577"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
 from {username='slave'} at 127.0.0.1:37276
I20260709 12:25:31.376464  4526 raft_consensus.cc:493] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:31.376971  4526 raft_consensus.cc:3060] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:31.377008  4600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:31.377243  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:31.377661  4600 raft_consensus.cc:3060] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:31.378129  4523 leader_election.cc:290] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 4 election: Requested vote from peers 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:31.378360  4522 raft_consensus.cc:515] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:31.377765  4675 raft_consensus.cc:3055] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:31.379642  4675 raft_consensus.cc:740] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Running, Role: LEADER
I20260709 12:25:31.380532  4675 consensus_queue.cc:260] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:31.381036  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eab1ee01b0447f187f838bad18a5422" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:31.381528  4599 raft_consensus.cc:3055] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:31.381807  4599 raft_consensus.cc:740] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Running, Role: LEADER
I20260709 12:25:31.382566  4599 consensus_queue.cc:260] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:31.383661  4599 raft_consensus.cc:3060] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:31.383996  4672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eab1ee01b0447f187f838bad18a5422" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:31.384532  4672 raft_consensus.cc:3060] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:31.385730  4600 raft_consensus.cc:2468] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 4.
I20260709 12:25:31.385442  4526 raft_consensus.cc:515] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:31.387583  4526 leader_election.cc:290] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 3 election: Requested vote from peers 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:31.381790  4675 raft_consensus.cc:3060] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:31.388994  4674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec13febd4da419182593ae351aae577" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:31.389621  4674 raft_consensus.cc:3060] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:31.390484  4599 raft_consensus.cc:2468] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 3.
I20260709 12:25:31.391254  4672 raft_consensus.cc:2468] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 3.
I20260709 12:25:31.392344  4491 leader_election.cc:304] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481fa219fb0146dfac14a92f2cb8f134, a46ce53289054c3b8cd158d2285506ef; no voters: 
I20260709 12:25:31.393460  4853 raft_consensus.cc:2804] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:31.393646  4489 leader_election.cc:304] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: 
I20260709 12:25:31.393924  4853 raft_consensus.cc:697] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 LEADER]: Becoming Leader. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:31.394747  4522 leader_election.cc:290] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 3 election: Requested vote from peers 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:31.394840  4853 consensus_queue.cc:237] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:31.395635  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec13febd4da419182593ae351aae577" candidate_uuid: "481fa219fb0146dfac14a92f2cb8f134" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:31.395653  4675 raft_consensus.cc:2468] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 4.
I20260709 12:25:31.396251  4599 raft_consensus.cc:3055] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:31.396575  4599 raft_consensus.cc:740] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Running, Role: LEADER
I20260709 12:25:31.397161  4847 raft_consensus.cc:2804] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:31.397354  4674 raft_consensus.cc:2468] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 3.
I20260709 12:25:31.397634  4847 raft_consensus.cc:697] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 4 LEADER]: Becoming Leader. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:31.397485  4599 consensus_queue.cc:260] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:31.398573  4847 consensus_queue.cc:237] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:31.399065  4599 raft_consensus.cc:3060] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:31.401645  4491 leader_election.cc:304] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481fa219fb0146dfac14a92f2cb8f134, a46ce53289054c3b8cd158d2285506ef; no voters: 
I20260709 12:25:31.402660  4862 raft_consensus.cc:2804] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:31.406894  4599 raft_consensus.cc:2468] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 481fa219fb0146dfac14a92f2cb8f134 in term 3.
I20260709 12:25:31.412417  4862 raft_consensus.cc:697] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 LEADER]: Becoming Leader. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:31.413519  4862 consensus_queue.cc:237] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:31.414630  4420 catalog_manager.cc:5697] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 reported cstate change: term changed from 2 to 3, leader changed from 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66) to 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65). New cstate: current_term: 3 leader_uuid: "481fa219fb0146dfac14a92f2cb8f134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.427932  4420 catalog_manager.cc:5697] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 reported cstate change: term changed from 3 to 4, leader changed from a46ce53289054c3b8cd158d2285506ef (127.3.200.67) to 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65). New cstate: current_term: 4 leader_uuid: "481fa219fb0146dfac14a92f2cb8f134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.429073  4420 catalog_manager.cc:5697] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 reported cstate change: term changed from 2 to 3, leader changed from 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66) to 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65). New cstate: current_term: 3 leader_uuid: "481fa219fb0146dfac14a92f2cb8f134" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:31.627843  4672 raft_consensus.cc:1275] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:31.629154  4862 consensus_queue.cc:1048] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:31.639163  4599 raft_consensus.cc:1275] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:31.640749  4847 consensus_queue.cc:1048] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:31.795470  4599 raft_consensus.cc:1275] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:31.796519  4862 consensus_queue.cc:1048] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:31.804802  4672 raft_consensus.cc:1275] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:31.806804  4865 consensus_queue.cc:1048] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:31.931527  4674 raft_consensus.cc:1275] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 4 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:31.933144  4865 consensus_queue.cc:1048] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:31.945459  4672 raft_consensus.cc:1275] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:31.947041  4862 consensus_queue.cc:1048] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:31.990131  4600 raft_consensus.cc:1275] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 4 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:32.008379  4601 raft_consensus.cc:1275] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:32.010608  4847 consensus_queue.cc:1048] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:32.016793  4675 raft_consensus.cc:1275] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 4 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:32.018239  4865 consensus_queue.cc:1048] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:32.013401  4847 consensus_queue.cc:1048] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:25:32.031155  4601 raft_consensus.cc:1275] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 4 FOLLOWER]: Refusing update from remote peer 481fa219fb0146dfac14a92f2cb8f134: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:32.042593  4847 consensus_queue.cc:1048] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:25:32.962865  4622 debug-util.cc:398] Leaking SignalData structure 0x7b0800110900 after lost signal to thread 3876
W20260709 12:25:32.963745  4622 debug-util.cc:398] Leaking SignalData structure 0x7b0800110fe0 after lost signal to thread 4458
W20260709 12:25:32.964610  4622 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9b80 after lost signal to thread 4550
W20260709 12:25:32.965335  4622 debug-util.cc:398] Leaking SignalData structure 0x7b08001201c0 after lost signal to thread 4625
W20260709 12:25:32.966060  4622 debug-util.cc:398] Leaking SignalData structure 0x7b080009e200 after lost signal to thread 4699
I20260709 12:25:34.202931  3873 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:25:34.203584  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:34.211189  4522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57692562c3c94894afe825af6d77fe58"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
mode: GRACEFUL
new_leader_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
 from {username='slave'} at 127.0.0.1:40854
I20260709 12:25:34.211715  4522 raft_consensus.cc:606] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Received request to transfer leadership to TS 3a617de8b64b4d698b80dc8d986b5e75
I20260709 12:25:34.214421  4522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cac76e593794fce9cf61281bee155ef"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
mode: GRACEFUL
new_leader_uuid: "a46ce53289054c3b8cd158d2285506ef"
 from {username='slave'} at 127.0.0.1:40854
I20260709 12:25:34.214882  4522 raft_consensus.cc:606] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 3 LEADER]: Received request to transfer leadership to TS a46ce53289054c3b8cd158d2285506ef
I20260709 12:25:34.218081  4522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
mode: GRACEFUL
new_leader_uuid: "a46ce53289054c3b8cd158d2285506ef"
 from {username='slave'} at 127.0.0.1:40854
I20260709 12:25:34.218662  4522 raft_consensus.cc:606] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 4 LEADER]: Received request to transfer leadership to TS a46ce53289054c3b8cd158d2285506ef
I20260709 12:25:34.220992  4522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a38c80acfeef458fadf844c1e895d8f8"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
mode: GRACEFUL
new_leader_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
 from {username='slave'} at 127.0.0.1:40854
I20260709 12:25:34.221503  4522 raft_consensus.cc:606] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Received request to transfer leadership to TS 3a617de8b64b4d698b80dc8d986b5e75
I20260709 12:25:34.222684  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:34.223165  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:34.324512  4883 raft_consensus.cc:993] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134: : Instructing follower 3a617de8b64b4d698b80dc8d986b5e75 to start an election
I20260709 12:25:34.325060  4865 raft_consensus.cc:1081] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Signalling peer 3a617de8b64b4d698b80dc8d986b5e75 to start an election
I20260709 12:25:34.326691  4599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57692562c3c94894afe825af6d77fe58"
dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
 from {username='slave'} at 127.0.0.1:59162
I20260709 12:25:34.327273  4599 raft_consensus.cc:493] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:34.327615  4599 raft_consensus.cc:3060] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:34.334766  4599 raft_consensus.cc:515] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:34.337379  4599 leader_election.cc:290] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 3 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:34.338296  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57692562c3c94894afe825af6d77fe58" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:34.338506  4674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57692562c3c94894afe825af6d77fe58" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:34.338954  4522 raft_consensus.cc:3055] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:34.339104  4674 raft_consensus.cc:3060] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:34.339342  4522 raft_consensus.cc:740] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:34.340240  4522 consensus_queue.cc:260] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:34.341648  4522 raft_consensus.cc:3060] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:34.346920  4674 raft_consensus.cc:2468] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 3.
I20260709 12:25:34.348493  4566 leader_election.cc:304] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, a46ce53289054c3b8cd158d2285506ef; no voters: 
I20260709 12:25:34.349556  4882 raft_consensus.cc:2804] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:34.349684  4522 raft_consensus.cc:2468] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 3.
I20260709 12:25:34.351025  4882 raft_consensus.cc:697] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 LEADER]: Becoming Leader. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Running, Role: LEADER
I20260709 12:25:34.352013  4882 consensus_queue.cc:237] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:34.359664  4420 catalog_manager.cc:5697] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 reported cstate change: term changed from 2 to 3, leader changed from 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65) to 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66). New cstate: current_term: 3 leader_uuid: "3a617de8b64b4d698b80dc8d986b5e75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:34.418382  4883 raft_consensus.cc:993] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134: : Instructing follower a46ce53289054c3b8cd158d2285506ef to start an election
I20260709 12:25:34.418865  4865 raft_consensus.cc:1081] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 3 LEADER]: Signalling peer a46ce53289054c3b8cd158d2285506ef to start an election
I20260709 12:25:34.420331  4674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cac76e593794fce9cf61281bee155ef"
dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
 from {username='slave'} at 127.0.0.1:40628
I20260709 12:25:34.420979  4674 raft_consensus.cc:493] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:34.421324  4674 raft_consensus.cc:3060] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:34.426035  4674 raft_consensus.cc:515] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:34.428992  4674 leader_election.cc:290] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 4 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317)
I20260709 12:25:34.429307  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac76e593794fce9cf61281bee155ef" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:34.429592  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cac76e593794fce9cf61281bee155ef" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:34.429898  4522 raft_consensus.cc:3055] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:34.430220  4599 raft_consensus.cc:3060] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:34.430254  4522 raft_consensus.cc:740] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:34.431149  4522 consensus_queue.cc:260] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:34.431999  4522 raft_consensus.cc:3060] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:34.436304  4522 raft_consensus.cc:2468] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 4.
I20260709 12:25:34.437088  4599 raft_consensus.cc:2468] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 4.
I20260709 12:25:34.437489  4640 leader_election.cc:304] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481fa219fb0146dfac14a92f2cb8f134, a46ce53289054c3b8cd158d2285506ef; no voters: 
I20260709 12:25:34.438230  4859 raft_consensus.cc:2804] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:34.439539  4859 raft_consensus.cc:697] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 4 LEADER]: Becoming Leader. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Running, Role: LEADER
I20260709 12:25:34.440459  4859 consensus_queue.cc:237] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:34.448338  4420 catalog_manager.cc:5697] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef reported cstate change: term changed from 3 to 4, leader changed from 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65) to a46ce53289054c3b8cd158d2285506ef (127.3.200.67). New cstate: current_term: 4 leader_uuid: "a46ce53289054c3b8cd158d2285506ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:34.464000  4892 raft_consensus.cc:993] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134: : Instructing follower 3a617de8b64b4d698b80dc8d986b5e75 to start an election
I20260709 12:25:34.464592  4883 raft_consensus.cc:1081] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Signalling peer 3a617de8b64b4d698b80dc8d986b5e75 to start an election
I20260709 12:25:34.466480  4599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a38c80acfeef458fadf844c1e895d8f8"
dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
 from {username='slave'} at 127.0.0.1:59162
I20260709 12:25:34.466956  4599 raft_consensus.cc:493] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:34.467252  4599 raft_consensus.cc:3060] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:34.471446  4599 raft_consensus.cc:515] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:34.472941  4599 leader_election.cc:290] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 3 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), a46ce53289054c3b8cd158d2285506ef (127.3.200.67:44471)
I20260709 12:25:34.473920  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38c80acfeef458fadf844c1e895d8f8" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:34.474277  4674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38c80acfeef458fadf844c1e895d8f8" candidate_uuid: "3a617de8b64b4d698b80dc8d986b5e75" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
I20260709 12:25:34.474462  4522 raft_consensus.cc:3055] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:34.474849  4522 raft_consensus.cc:740] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:34.474895  4674 raft_consensus.cc:3060] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:34.475557  4522 consensus_queue.cc:260] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:34.476486  4522 raft_consensus.cc:3060] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:34.480641  4522 raft_consensus.cc:2468] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 3.
I20260709 12:25:34.481619  4566 leader_election.cc:304] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, 481fa219fb0146dfac14a92f2cb8f134; no voters: 
I20260709 12:25:34.482275  4882 raft_consensus.cc:2804] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:34.482723  4882 raft_consensus.cc:697] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 LEADER]: Becoming Leader. State: Replica: 3a617de8b64b4d698b80dc8d986b5e75, State: Running, Role: LEADER
I20260709 12:25:34.482787  4674 raft_consensus.cc:2468] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a617de8b64b4d698b80dc8d986b5e75 in term 3.
I20260709 12:25:34.483664  4882 consensus_queue.cc:237] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:34.491479  4420 catalog_manager.cc:5697] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 reported cstate change: term changed from 2 to 3, leader changed from 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65) to 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66). New cstate: current_term: 3 leader_uuid: "3a617de8b64b4d698b80dc8d986b5e75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:35.112596  4865 raft_consensus.cc:993] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134: : Instructing follower a46ce53289054c3b8cd158d2285506ef to start an election
I20260709 12:25:35.113577  4865 raft_consensus.cc:1081] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 4 LEADER]: Signalling peer a46ce53289054c3b8cd158d2285506ef to start an election
I20260709 12:25:35.127562  4675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5"
dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
 from {username='slave'} at 127.0.0.1:40628
I20260709 12:25:35.128819  4675 raft_consensus.cc:493] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:35.129387  4675 raft_consensus.cc:3060] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:35.140759  4675 raft_consensus.cc:515] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:35.148396  4674 raft_consensus.cc:1275] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Refusing update from remote peer 3a617de8b64b4d698b80dc8d986b5e75: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:35.153192  4896 consensus_queue.cc:1048] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:35.154659  4674 raft_consensus.cc:1275] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Refusing update from remote peer 3a617de8b64b4d698b80dc8d986b5e75: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:35.159356  4522 raft_consensus.cc:1275] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Refusing update from remote peer 3a617de8b64b4d698b80dc8d986b5e75: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:35.161592  4522 raft_consensus.cc:1275] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Refusing update from remote peer 3a617de8b64b4d698b80dc8d986b5e75: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:35.162346  4675 leader_election.cc:290] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 5 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317)
I20260709 12:25:35.163898  4895 consensus_queue.cc:1048] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:35.166473  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:35.167095  4522 raft_consensus.cc:3055] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:35.167399  4522 raft_consensus.cc:740] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:35.168231  4522 consensus_queue.cc:260] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:35.171695  4522 raft_consensus.cc:3060] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:35.169647  4526 raft_consensus.cc:1275] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 4 FOLLOWER]: Refusing update from remote peer a46ce53289054c3b8cd158d2285506ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:35.176429  4898 consensus_queue.cc:1048] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:35.176707  4895 consensus_queue.cc:1048] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:35.176450  4897 consensus_queue.cc:1048] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:25:35.195456  4522 raft_consensus.cc:2468] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 5.
I20260709 12:25:35.200942  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d589545cf8445a1bb29cdeeff34bef5" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:35.201967  4640 leader_election.cc:304] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 481fa219fb0146dfac14a92f2cb8f134, a46ce53289054c3b8cd158d2285506ef; no voters: 
I20260709 12:25:35.202847  4599 raft_consensus.cc:3060] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:35.203558  4898 raft_consensus.cc:2804] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:35.204183  4898 raft_consensus.cc:697] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 5 LEADER]: Becoming Leader. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Running, Role: LEADER
I20260709 12:25:35.205492  4898 consensus_queue.cc:237] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:35.210999  4599 raft_consensus.cc:2468] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 5.
I20260709 12:25:35.221760  4598 raft_consensus.cc:1275] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 4 FOLLOWER]: Refusing update from remote peer a46ce53289054c3b8cd158d2285506ef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:35.243016  4909 consensus_queue.cc:1048] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:35.273573  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:35.308900  4524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181"
dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
mode: GRACEFUL
new_leader_uuid: "a46ce53289054c3b8cd158d2285506ef"
 from {username='slave'} at 127.0.0.1:40854
I20260709 12:25:35.309687  4524 raft_consensus.cc:606] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 4 LEADER]: Received request to transfer leadership to TS a46ce53289054c3b8cd158d2285506ef
I20260709 12:25:35.313593  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:25:35.320581  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:35.326828  4423 catalog_manager.cc:5697] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef reported cstate change: term changed from 4 to 5, leader changed from 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65) to a46ce53289054c3b8cd158d2285506ef (127.3.200.67). New cstate: current_term: 5 leader_uuid: "a46ce53289054c3b8cd158d2285506ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:35.482738  4865 raft_consensus.cc:993] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134: : Instructing follower a46ce53289054c3b8cd158d2285506ef to start an election
I20260709 12:25:35.483314  4899 raft_consensus.cc:1081] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 4 LEADER]: Signalling peer a46ce53289054c3b8cd158d2285506ef to start an election
I20260709 12:25:35.485066  4674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181"
dest_uuid: "a46ce53289054c3b8cd158d2285506ef"
 from {username='slave'} at 127.0.0.1:40628
I20260709 12:25:35.485682  4674 raft_consensus.cc:493] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:35.486053  4674 raft_consensus.cc:3060] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:35.494165  4674 raft_consensus.cc:515] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:35.496344  4674 leader_election.cc:290] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 5 election: Requested vote from peers 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409), 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317)
I20260709 12:25:35.497273  4523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "481fa219fb0146dfac14a92f2cb8f134"
I20260709 12:25:35.497694  4598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da90399573cd4e89bda769cee6c7d181" candidate_uuid: "a46ce53289054c3b8cd158d2285506ef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3a617de8b64b4d698b80dc8d986b5e75"
I20260709 12:25:35.497857  4523 raft_consensus.cc:3055] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:35.498236  4523 raft_consensus.cc:740] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 481fa219fb0146dfac14a92f2cb8f134, State: Running, Role: LEADER
I20260709 12:25:35.498282  4598 raft_consensus.cc:3060] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:35.499150  4523 consensus_queue.cc:260] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:35.500455  4523 raft_consensus.cc:3060] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:35.506179  4598 raft_consensus.cc:2468] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 5.
I20260709 12:25:35.507802  4523 raft_consensus.cc:2468] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46ce53289054c3b8cd158d2285506ef in term 5.
I20260709 12:25:35.507771  4638 leader_election.cc:304] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a617de8b64b4d698b80dc8d986b5e75, a46ce53289054c3b8cd158d2285506ef; no voters: 
I20260709 12:25:35.508800  4909 raft_consensus.cc:2804] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:35.509317  4909 raft_consensus.cc:697] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 5 LEADER]: Becoming Leader. State: Replica: a46ce53289054c3b8cd158d2285506ef, State: Running, Role: LEADER
I20260709 12:25:35.510226  4909 consensus_queue.cc:237] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } }
I20260709 12:25:35.523892  4423 catalog_manager.cc:5697] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef reported cstate change: term changed from 4 to 5, leader changed from 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65) to a46ce53289054c3b8cd158d2285506ef (127.3.200.67). New cstate: current_term: 5 leader_uuid: "a46ce53289054c3b8cd158d2285506ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46ce53289054c3b8cd158d2285506ef" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 44471 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:35.597004  4523 raft_consensus.cc:1275] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 5 FOLLOWER]: Refusing update from remote peer a46ce53289054c3b8cd158d2285506ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:35.598107  4909 consensus_queue.cc:1048] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:35.617075  4598 raft_consensus.cc:1275] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 5 FOLLOWER]: Refusing update from remote peer a46ce53289054c3b8cd158d2285506ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:35.618580  4909 consensus_queue.cc:1048] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:35.982954  4598 raft_consensus.cc:1275] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 5 FOLLOWER]: Refusing update from remote peer a46ce53289054c3b8cd158d2285506ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:35.984477  4901 consensus_queue.cc:1048] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a617de8b64b4d698b80dc8d986b5e75" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 46317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:35.994741  4523 raft_consensus.cc:1275] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 5 FOLLOWER]: Refusing update from remote peer a46ce53289054c3b8cd158d2285506ef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:35.996675  4898 consensus_queue.cc:1048] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "481fa219fb0146dfac14a92f2cb8f134" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:25:36.165295  4696 debug-util.cc:398] Leaking SignalData structure 0x7b08000a9a40 after lost signal to thread 3876
W20260709 12:25:36.166179  4696 debug-util.cc:398] Leaking SignalData structure 0x7b08001f42c0 after lost signal to thread 4458
W20260709 12:25:36.167217  4696 debug-util.cc:398] Leaking SignalData structure 0x7b080010c280 after lost signal to thread 4550
W20260709 12:25:36.168159  4696 debug-util.cc:398] Leaking SignalData structure 0x7b08001fe6e0 after lost signal to thread 4625
W20260709 12:25:36.169111  4696 debug-util.cc:398] Leaking SignalData structure 0x7b08000975e0 after lost signal to thread 4699
I20260709 12:25:36.322036  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:36.331854  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:36.332535  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:37.333745  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:37.342902  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:37.343550  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:38.409265  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:38.414690  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:38.415122  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:25:38.899700  4454 debug-util.cc:398] Leaking SignalData structure 0x7b08000542a0 after lost signal to thread 3876
W20260709 12:25:38.900597  4454 debug-util.cc:398] Leaking SignalData structure 0x7b0800054980 after lost signal to thread 4458
W20260709 12:25:38.901496  4454 debug-util.cc:398] Leaking SignalData structure 0x7b08001b47c0 after lost signal to thread 4550
W20260709 12:25:38.902381  4454 debug-util.cc:398] Leaking SignalData structure 0x7b08001ff7a0 after lost signal to thread 4625
W20260709 12:25:38.903471  4454 debug-util.cc:398] Leaking SignalData structure 0x7b08001e3c60 after lost signal to thread 4699
I20260709 12:25:39.416010  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:39.423431  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:39.423892  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:40.424866  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:40.430684  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:40.431180  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:41.432255  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:41.437687  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:41.438151  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:42.439262  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:42.445161  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:42.445623  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:43.446722  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:43.452404  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:43.452869  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:44.485481  3873 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:25:44.485996  3873 tablet_server.cc:179] TabletServer@127.3.200.65:0 shutting down...
W20260709 12:25:44.493098  4566 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 12:25:44.496197  4566 consensus_peers.cc:597] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 -> Peer 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409): Couldn't send request to peer 481fa219fb0146dfac14a92f2cb8f134. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:44.514816  3873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:44.515589  3873 tablet_replica.cc:333] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134: stopping tablet replica
I20260709 12:25:44.516254  3873 raft_consensus.cc:2243] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:44.517091  3873 raft_consensus.cc:2272] T aec13febd4da419182593ae351aae577 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.518922  3873 tablet_replica.cc:333] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134: stopping tablet replica
I20260709 12:25:44.519462  3873 raft_consensus.cc:2243] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.519877  3873 raft_consensus.cc:2272] T 57692562c3c94894afe825af6d77fe58 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.521644  3873 tablet_replica.cc:333] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134: stopping tablet replica
I20260709 12:25:44.522161  3873 raft_consensus.cc:2243] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.522563  3873 raft_consensus.cc:2272] T 6cac76e593794fce9cf61281bee155ef P 481fa219fb0146dfac14a92f2cb8f134 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.524094  3873 tablet_replica.cc:333] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134: stopping tablet replica
I20260709 12:25:44.524693  3873 raft_consensus.cc:2243] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.525095  3873 raft_consensus.cc:2272] T 7861580b029e4832b72b175f808a0ca1 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.526652  3873 tablet_replica.cc:333] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 481fa219fb0146dfac14a92f2cb8f134: stopping tablet replica
I20260709 12:25:44.527127  3873 raft_consensus.cc:2243] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.527580  3873 raft_consensus.cc:2272] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 481fa219fb0146dfac14a92f2cb8f134 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.529984  3873 tablet_replica.cc:333] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134: stopping tablet replica
I20260709 12:25:44.530745  3873 raft_consensus.cc:2243] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:44.531433  3873 raft_consensus.cc:2272] T 61866bd2197541018e7751ff916bd471 P 481fa219fb0146dfac14a92f2cb8f134 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.533030  3873 tablet_replica.cc:333] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134: stopping tablet replica
I20260709 12:25:44.533452  3873 raft_consensus.cc:2243] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.533776  3873 raft_consensus.cc:2272] T da90399573cd4e89bda769cee6c7d181 P 481fa219fb0146dfac14a92f2cb8f134 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.535234  3873 tablet_replica.cc:333] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134: stopping tablet replica
I20260709 12:25:44.535645  3873 raft_consensus.cc:2243] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.535965  3873 raft_consensus.cc:2272] T a38c80acfeef458fadf844c1e895d8f8 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.537497  3873 tablet_replica.cc:333] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134: stopping tablet replica
I20260709 12:25:44.537900  3873 raft_consensus.cc:2243] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:44.538527  3873 raft_consensus.cc:2272] T 9eab1ee01b0447f187f838bad18a5422 P 481fa219fb0146dfac14a92f2cb8f134 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.540055  3873 tablet_replica.cc:333] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134: stopping tablet replica
I20260709 12:25:44.540542  3873 raft_consensus.cc:2243] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.540974  3873 raft_consensus.cc:2272] T 6d589545cf8445a1bb29cdeeff34bef5 P 481fa219fb0146dfac14a92f2cb8f134 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.570315  3873 tablet_server.cc:196] TabletServer@127.3.200.65:0 shutdown complete.
I20260709 12:25:44.590565  3873 tablet_server.cc:179] TabletServer@127.3.200.66:0 shutting down...
I20260709 12:25:44.621201  3873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:44.621899  3873 tablet_replica.cc:333] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75: stopping tablet replica
I20260709 12:25:44.622638  3873 raft_consensus.cc:2243] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:44.623478  3873 raft_consensus.cc:2272] T a38c80acfeef458fadf844c1e895d8f8 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.625552  3873 tablet_replica.cc:333] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75: stopping tablet replica
I20260709 12:25:44.626133  3873 raft_consensus.cc:2243] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.626588  3873 raft_consensus.cc:2272] T 9eab1ee01b0447f187f838bad18a5422 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.628476  3873 tablet_replica.cc:333] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75: stopping tablet replica
I20260709 12:25:44.629163  3873 raft_consensus.cc:2243] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:44.629973  3873 raft_consensus.cc:2272] T 57692562c3c94894afe825af6d77fe58 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.632061  3873 tablet_replica.cc:333] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75: stopping tablet replica
I20260709 12:25:44.632651  3873 raft_consensus.cc:2243] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.633054  3873 raft_consensus.cc:2272] T aec13febd4da419182593ae351aae577 P 3a617de8b64b4d698b80dc8d986b5e75 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.634763  3873 tablet_replica.cc:333] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75: stopping tablet replica
I20260709 12:25:44.635265  3873 raft_consensus.cc:2243] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.635640  3873 raft_consensus.cc:2272] T 6cac76e593794fce9cf61281bee155ef P 3a617de8b64b4d698b80dc8d986b5e75 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.655282  3873 tablet_replica.cc:333] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75: stopping tablet replica
I20260709 12:25:44.657176  3873 raft_consensus.cc:2243] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.658546  3873 raft_consensus.cc:2272] T 6d589545cf8445a1bb29cdeeff34bef5 P 3a617de8b64b4d698b80dc8d986b5e75 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.662436  3873 tablet_replica.cc:333] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75: stopping tablet replica
I20260709 12:25:44.663324  3873 raft_consensus.cc:2243] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.664142  3873 raft_consensus.cc:2272] T 61866bd2197541018e7751ff916bd471 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:44.664778  4640 consensus_peers.cc:597] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef -> Peer 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409): Couldn't send request to peer 481fa219fb0146dfac14a92f2cb8f134. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:45409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:44.666656  3873 tablet_replica.cc:333] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75: stopping tablet replica
I20260709 12:25:44.667171  3873 raft_consensus.cc:2243] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.667778  3873 raft_consensus.cc:2272] T da90399573cd4e89bda769cee6c7d181 P 3a617de8b64b4d698b80dc8d986b5e75 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.669945  3873 tablet_replica.cc:333] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75: stopping tablet replica
I20260709 12:25:44.670454  3873 raft_consensus.cc:2243] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:44.671669  3873 raft_consensus.cc:2272] T 7861580b029e4832b72b175f808a0ca1 P 3a617de8b64b4d698b80dc8d986b5e75 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.673750  3873 tablet_replica.cc:333] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75: stopping tablet replica
I20260709 12:25:44.674157  3873 raft_consensus.cc:2243] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.674633  3873 raft_consensus.cc:2272] T 52d137fef3dc4eaebd1a9d7c93a7b575 P 3a617de8b64b4d698b80dc8d986b5e75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.726475  3873 tablet_server.cc:196] TabletServer@127.3.200.66:0 shutdown complete.
W20260709 12:25:44.751929  4638 consensus_peers.cc:597] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef -> Peer 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317): Couldn't send request to peer 3a617de8b64b4d698b80dc8d986b5e75. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:46317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:44.753693  3873 tablet_server.cc:179] TabletServer@127.3.200.67:0 shutting down...
W20260709 12:25:44.758311  4638 consensus_peers.cc:597] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef -> Peer 3a617de8b64b4d698b80dc8d986b5e75 (127.3.200.66:46317): Couldn't send request to peer 3a617de8b64b4d698b80dc8d986b5e75. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:46317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:44.760092  4640 consensus_peers.cc:597] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef -> Peer 481fa219fb0146dfac14a92f2cb8f134 (127.3.200.65:45409): Couldn't send request to peer 481fa219fb0146dfac14a92f2cb8f134. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:45409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:44.784384  3873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:44.785316  3873 tablet_replica.cc:333] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef: stopping tablet replica
I20260709 12:25:44.786401  3873 raft_consensus.cc:2243] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.787114  3873 raft_consensus.cc:2272] T 9eab1ee01b0447f187f838bad18a5422 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.789417  3873 tablet_replica.cc:333] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef: stopping tablet replica
I20260709 12:25:44.790135  3873 raft_consensus.cc:2243] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:25:44.791090  3873 raft_consensus.cc:2272] T 6d589545cf8445a1bb29cdeeff34bef5 P a46ce53289054c3b8cd158d2285506ef [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.793123  3873 tablet_replica.cc:333] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef: stopping tablet replica
I20260709 12:25:44.793749  3873 raft_consensus.cc:2243] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:25:44.794826  3873 raft_consensus.cc:2272] T da90399573cd4e89bda769cee6c7d181 P a46ce53289054c3b8cd158d2285506ef [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.797151  3873 tablet_replica.cc:333] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef: stopping tablet replica
I20260709 12:25:44.797730  3873 raft_consensus.cc:2243] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.798262  3873 raft_consensus.cc:2272] T 61866bd2197541018e7751ff916bd471 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.800223  3873 tablet_replica.cc:333] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef: stopping tablet replica
I20260709 12:25:44.800783  3873 raft_consensus.cc:2243] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:44.801677  3873 raft_consensus.cc:2272] T 6cac76e593794fce9cf61281bee155ef P a46ce53289054c3b8cd158d2285506ef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.803372  3873 tablet_replica.cc:333] T 7861580b029e4832b72b175f808a0ca1 P a46ce53289054c3b8cd158d2285506ef: stopping tablet replica
I20260709 12:25:44.803912  3873 raft_consensus.cc:2243] T 7861580b029e4832b72b175f808a0ca1 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.804431  3873 raft_consensus.cc:2272] T 7861580b029e4832b72b175f808a0ca1 P a46ce53289054c3b8cd158d2285506ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.806254  3873 tablet_replica.cc:333] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef: stopping tablet replica
I20260709 12:25:44.806782  3873 raft_consensus.cc:2243] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:44.807752  3873 raft_consensus.cc:2272] T 52d137fef3dc4eaebd1a9d7c93a7b575 P a46ce53289054c3b8cd158d2285506ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.809511  3873 tablet_replica.cc:333] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef: stopping tablet replica
I20260709 12:25:44.810014  3873 raft_consensus.cc:2243] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.810534  3873 raft_consensus.cc:2272] T aec13febd4da419182593ae351aae577 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.812285  3873 tablet_replica.cc:333] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef: stopping tablet replica
I20260709 12:25:44.813102  3873 raft_consensus.cc:2243] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.813763  3873 raft_consensus.cc:2272] T 57692562c3c94894afe825af6d77fe58 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.815497  3873 tablet_replica.cc:333] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef: stopping tablet replica
I20260709 12:25:44.816006  3873 raft_consensus.cc:2243] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:44.816496  3873 raft_consensus.cc:2272] T a38c80acfeef458fadf844c1e895d8f8 P a46ce53289054c3b8cd158d2285506ef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.867895  3873 tablet_server.cc:196] TabletServer@127.3.200.67:0 shutdown complete.
I20260709 12:25:44.889780  3873 master.cc:562] Master@127.3.200.126:39375 shutting down...
I20260709 12:25:44.919282  3873 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:44.919939  3873 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:44.920341  3873 tablet_replica.cc:333] T 00000000000000000000000000000000 P f0662c1578d041e08e8483aec97790d3: stopping tablet replica
I20260709 12:25:44.957952  3873 master.cc:584] Master@127.3.200.126:39375 shutdown complete.
3a617de8b64b4d698b80dc8d986b5e75  4
481fa219fb0146dfac14a92f2cb8f134  5
a46ce53289054c3b8cd158d2285506ef  1
3a617de8b64b4d698b80dc8d986b5e75  4
481fa219fb0146dfac14a92f2cb8f134  3
a46ce53289054c3b8cd158d2285506ef  3
3a617de8b64b4d698b80dc8d986b5e75  1
481fa219fb0146dfac14a92f2cb8f134  8
a46ce53289054c3b8cd158d2285506ef  1
3a617de8b64b4d698b80dc8d986b5e75  3
481fa219fb0146dfac14a92f2cb8f134  3
a46ce53289054c3b8cd158d2285506ef  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29609 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:25:45.003401  3873 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.200.126:42719
I20260709 12:25:45.004724  3873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:45.010679  4947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:45.010959  4946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:45.011396  4949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:45.012156  3873 server_base.cc:1061] running on GCE node
I20260709 12:25:45.013620  3873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:45.013799  3873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:45.014003  3873 hybrid_clock.cc:648] HybridClock initialized: now 1783599945013973 us; error 0 us; skew 500 ppm
I20260709 12:25:45.014598  3873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:45.017155  3873 webserver.cc:533] Webserver started at http://127.3.200.126:43851/ using document root <none> and password file <none>
I20260709 12:25:45.017673  3873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:45.017870  3873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:45.018164  3873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:45.019410  3873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/master-0-root/instance:
uuid: "0b37addd7ee64e1680b0efd2b27b9300"
format_stamp: "Formatted at 2026-07-09 12:25:45 on dist-test-slave-px1m"
I20260709 12:25:45.024047  3873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:25:45.027827  4954 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:45.028780  3873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:45.029048  3873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/master-0-root
uuid: "0b37addd7ee64e1680b0efd2b27b9300"
format_stamp: "Formatted at 2026-07-09 12:25:45 on dist-test-slave-px1m"
I20260709 12:25:45.029310  3873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:45.045584  3873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:45.046806  3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:45.085561  3873 rpc_server.cc:307] RPC server started. Bound to: 127.3.200.126:42719
I20260709 12:25:45.085639  5005 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.200.126:42719 every 8 connection(s)
I20260709 12:25:45.089669  5006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.099897  5006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300: Bootstrap starting.
I20260709 12:25:45.104802  5006 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.109305  5006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300: No bootstrap required, opened a new log
I20260709 12:25:45.111773  5006 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b37addd7ee64e1680b0efd2b27b9300" member_type: VOTER }
I20260709 12:25:45.112484  5006 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.112834  5006 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b37addd7ee64e1680b0efd2b27b9300, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.113571  5006 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b37addd7ee64e1680b0efd2b27b9300" member_type: VOTER }
I20260709 12:25:45.114298  5006 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:45.114567  5006 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:45.114923  5006 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.119356  5006 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b37addd7ee64e1680b0efd2b27b9300" member_type: VOTER }
I20260709 12:25:45.119890  5006 leader_election.cc:304] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b37addd7ee64e1680b0efd2b27b9300; no voters: 
I20260709 12:25:45.121131  5006 leader_election.cc:290] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:45.121567  5009 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:45.123050  5009 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [term 1 LEADER]: Becoming Leader. State: Replica: 0b37addd7ee64e1680b0efd2b27b9300, State: Running, Role: LEADER
I20260709 12:25:45.123703  5009 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b37addd7ee64e1680b0efd2b27b9300" member_type: VOTER }
I20260709 12:25:45.124192  5006 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:45.131544  5011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b37addd7ee64e1680b0efd2b27b9300. Latest consensus state: current_term: 1 leader_uuid: "0b37addd7ee64e1680b0efd2b27b9300" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b37addd7ee64e1680b0efd2b27b9300" member_type: VOTER } }
I20260709 12:25:45.132105  5011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:45.133054  5010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b37addd7ee64e1680b0efd2b27b9300" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b37addd7ee64e1680b0efd2b27b9300" member_type: VOTER } }
I20260709 12:25:45.133790  5010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:45.134078  5019 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:45.141779  5019 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:45.142700  3873 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:45.151558  5019 catalog_manager.cc:1383] Generated new cluster ID: 8d39289d8290425caa4200afe4b72e23
I20260709 12:25:45.151865  5019 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:45.171233  5019 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:45.172508  5019 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:45.189215  5019 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300: Generated new TSK 0
I20260709 12:25:45.189863  5019 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:45.209098  3873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:45.214953  5027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:45.216325  5028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:45.217806  5030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:45.219771  3873 server_base.cc:1061] running on GCE node
I20260709 12:25:45.220847  3873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:45.221051  3873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:45.221421  3873 hybrid_clock.cc:648] HybridClock initialized: now 1783599945221383 us; error 0 us; skew 500 ppm
I20260709 12:25:45.222035  3873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:45.224339  3873 webserver.cc:533] Webserver started at http://127.3.200.65:35399/ using document root <none> and password file <none>
I20260709 12:25:45.224862  3873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:45.225059  3873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:45.225378  3873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:45.226702  3873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root/instance:
uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
format_stamp: "Formatted at 2026-07-09 12:25:45 on dist-test-slave-px1m"
I20260709 12:25:45.231523  3873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:25:45.234942  5035 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:45.235718  3873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:25:45.236013  3873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root
uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
format_stamp: "Formatted at 2026-07-09 12:25:45 on dist-test-slave-px1m"
I20260709 12:25:45.236277  3873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:45.261505  3873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:45.262776  3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:45.264281  3873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:45.266716  3873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:45.266947  3873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:45.267225  3873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:45.267408  3873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:45.306640  3873 rpc_server.cc:307] RPC server started. Bound to: 127.3.200.65:37149
I20260709 12:25:45.306751  5097 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.200.65:37149 every 8 connection(s)
I20260709 12:25:45.311849  3873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:45.319386  5102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:45.321722  5103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:45.323315  3873 server_base.cc:1061] running on GCE node
W20260709 12:25:45.324594  5106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:45.324891  5098 heartbeater.cc:344] Connected to a master server at 127.3.200.126:42719
I20260709 12:25:45.325331  5098 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:45.325745  3873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:45.325977  3873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:45.326160  3873 hybrid_clock.cc:648] HybridClock initialized: now 1783599945326145 us; error 0 us; skew 500 ppm
I20260709 12:25:45.326383  5098 heartbeater.cc:507] Master 127.3.200.126:42719 requested a full tablet report, sending...
I20260709 12:25:45.326699  3873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:45.328922  4971 ts_manager.cc:194] Registered new tserver with Master: 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149)
I20260709 12:25:45.329196  3873 webserver.cc:533] Webserver started at http://127.3.200.66:41523/ using document root <none> and password file <none>
I20260709 12:25:45.329682  3873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:45.329864  3873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:45.330087  3873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:45.331115  4971 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35832
I20260709 12:25:45.331197  3873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-1-root/instance:
uuid: "d22f4ab7b09f42258209170e7c9214cb"
format_stamp: "Formatted at 2026-07-09 12:25:45 on dist-test-slave-px1m"
I20260709 12:25:45.336035  3873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:25:45.339558  5110 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:45.340376  3873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:25:45.340803  3873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-1-root
uuid: "d22f4ab7b09f42258209170e7c9214cb"
format_stamp: "Formatted at 2026-07-09 12:25:45 on dist-test-slave-px1m"
I20260709 12:25:45.341110  3873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:45.355264  3873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:45.356809  3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:45.358395  3873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:45.361030  3873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:45.361301  3873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:45.361562  3873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:45.361764  3873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:45.404826  3873 rpc_server.cc:307] RPC server started. Bound to: 127.3.200.66:37067
I20260709 12:25:45.404914  5172 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.200.66:37067 every 8 connection(s)
I20260709 12:25:45.410002  3873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:45.417631  5176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:45.420333  5177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:45.422580  5179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:45.423130  3873 server_base.cc:1061] running on GCE node
I20260709 12:25:45.423327  5173 heartbeater.cc:344] Connected to a master server at 127.3.200.126:42719
I20260709 12:25:45.423739  5173 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:45.424175  3873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:45.424443  3873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:45.424693  3873 hybrid_clock.cc:648] HybridClock initialized: now 1783599945424673 us; error 0 us; skew 500 ppm
I20260709 12:25:45.424686  5173 heartbeater.cc:507] Master 127.3.200.126:42719 requested a full tablet report, sending...
I20260709 12:25:45.425601  3873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:45.427380  4971 ts_manager.cc:194] Registered new tserver with Master: d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:45.428586  3873 webserver.cc:533] Webserver started at http://127.3.200.67:44723/ using document root <none> and password file <none>
I20260709 12:25:45.429261  3873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:45.429386  4971 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35846
I20260709 12:25:45.429538  3873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:45.429930  3873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:45.431572  3873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-2-root/instance:
uuid: "6e72ecbdf12a4160856b2a57422118a3"
format_stamp: "Formatted at 2026-07-09 12:25:45 on dist-test-slave-px1m"
I20260709 12:25:45.436494  3873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:25:45.440014  5184 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:45.440924  3873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:45.441284  3873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-2-root
uuid: "6e72ecbdf12a4160856b2a57422118a3"
format_stamp: "Formatted at 2026-07-09 12:25:45 on dist-test-slave-px1m"
I20260709 12:25:45.441569  3873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:45.454775  3873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:45.456039  3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:45.457751  3873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:45.459905  3873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:45.460130  3873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:45.460381  3873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:45.460554  3873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:45.500430  3873 rpc_server.cc:307] RPC server started. Bound to: 127.3.200.67:43993
I20260709 12:25:45.500526  5246 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.200.67:43993 every 8 connection(s)
I20260709 12:25:45.514537  5247 heartbeater.cc:344] Connected to a master server at 127.3.200.126:42719
I20260709 12:25:45.514948  5247 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:45.515689  5247 heartbeater.cc:507] Master 127.3.200.126:42719 requested a full tablet report, sending...
I20260709 12:25:45.517729  4971 ts_manager.cc:194] Registered new tserver with Master: 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:45.518502  3873 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014837695s
I20260709 12:25:45.519101  4971 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35862
I20260709 12:25:45.545244  4971 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35868:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:45.551430  4971 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:45.755110  5063 tablet_service.cc:1511] Processing CreateTablet for tablet 9ea368926e6346baa3b0065d3c9c510e (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:45.757673  5062 tablet_service.cc:1511] Processing CreateTablet for tablet d4c6522d7db94a48b906c63f7c31b8e6 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:45.760030  5061 tablet_service.cc:1511] Processing CreateTablet for tablet c872a85641bb42caaf228b2eeeafcc93 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:45.761452  5136 tablet_service.cc:1511] Processing CreateTablet for tablet c872a85641bb42caaf228b2eeeafcc93 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:45.761650  5138 tablet_service.cc:1511] Processing CreateTablet for tablet 9ea368926e6346baa3b0065d3c9c510e (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:45.762884  5136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c872a85641bb42caaf228b2eeeafcc93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.763576  5058 tablet_service.cc:1511] Processing CreateTablet for tablet d1704f04d7be4e899c5cf5d05207f303 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:45.764312  5134 tablet_service.cc:1511] Processing CreateTablet for tablet 500a5a8d445949f0b0d635fd3820f5c9 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:45.765861  5059 tablet_service.cc:1511] Processing CreateTablet for tablet 500a5a8d445949f0b0d635fd3820f5c9 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:45.766361  5135 tablet_service.cc:1511] Processing CreateTablet for tablet 52040c8bb853412eae96ea2727c6f8f5 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:45.762504  5133 tablet_service.cc:1511] Processing CreateTablet for tablet d1704f04d7be4e899c5cf5d05207f303 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:45.768209  5134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 500a5a8d445949f0b0d635fd3820f5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.768083  5060 tablet_service.cc:1511] Processing CreateTablet for tablet 52040c8bb853412eae96ea2727c6f8f5 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:45.760223  5137 tablet_service.cc:1511] Processing CreateTablet for tablet d4c6522d7db94a48b906c63f7c31b8e6 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:45.770226  5135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52040c8bb853412eae96ea2727c6f8f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.771224  5063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ea368926e6346baa3b0065d3c9c510e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.771447  5057 tablet_service.cc:1511] Processing CreateTablet for tablet 8c3c3b60ecf04db989b454ae1f760212 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:45.772773  5057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3c3b60ecf04db989b454ae1f760212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.773236  5137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c6522d7db94a48b906c63f7c31b8e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.773885  5060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52040c8bb853412eae96ea2727c6f8f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.774837  5056 tablet_service.cc:1511] Processing CreateTablet for tablet 47ebaac790104c1b849ecbeadadc2ac6 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:45.776108  5056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ebaac790104c1b849ecbeadadc2ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.777204  5133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1704f04d7be4e899c5cf5d05207f303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.777745  5055 tablet_service.cc:1511] Processing CreateTablet for tablet 5b00d99b54ae4fda8d58410ef0b5c3e3 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:45.779023  5055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b00d99b54ae4fda8d58410ef0b5c3e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.780867  5058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1704f04d7be4e899c5cf5d05207f303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.781204  5138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ea368926e6346baa3b0065d3c9c510e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.781772  5054 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1a988a2c4745a2baccff62720af502 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:45.783056  5054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1a988a2c4745a2baccff62720af502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.784888  5059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 500a5a8d445949f0b0d635fd3820f5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.785524  5061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c872a85641bb42caaf228b2eeeafcc93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.786688  5062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c6522d7db94a48b906c63f7c31b8e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.791579  5132 tablet_service.cc:1511] Processing CreateTablet for tablet 8c3c3b60ecf04db989b454ae1f760212 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:45.792346  5129 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1a988a2c4745a2baccff62720af502 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:45.793764  5131 tablet_service.cc:1511] Processing CreateTablet for tablet 47ebaac790104c1b849ecbeadadc2ac6 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:45.795740  5130 tablet_service.cc:1511] Processing CreateTablet for tablet 5b00d99b54ae4fda8d58410ef0b5c3e3 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:45.797431  5132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3c3b60ecf04db989b454ae1f760212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.800141  5130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b00d99b54ae4fda8d58410ef0b5c3e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.802382  5129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1a988a2c4745a2baccff62720af502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.805109  5131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ebaac790104c1b849ecbeadadc2ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.846625  5060 tablet_service.cc:1511] Processing CreateTablet for tablet 56941204ae3e40bba5254fad3092ebeb (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:45.848029  5060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56941204ae3e40bba5254fad3092ebeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.850548  5062 tablet_service.cc:1511] Processing CreateTablet for tablet b5afebfa702646d8b7372e8562e97d71 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:45.851820  5062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5afebfa702646d8b7372e8562e97d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.858727  5131 tablet_service.cc:1511] Processing CreateTablet for tablet 56941204ae3e40bba5254fad3092ebeb (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:45.859447  5063 tablet_service.cc:1511] Processing CreateTablet for tablet 04f60339b6c34e54bbf6e9b4a4c1e54e (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:45.859985  5131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56941204ae3e40bba5254fad3092ebeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.860711  5063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f60339b6c34e54bbf6e9b4a4c1e54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.881295  5058 tablet_service.cc:1511] Processing CreateTablet for tablet 22b25036e425414d9ac336d8b3074769 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:45.884234  5058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b25036e425414d9ac336d8b3074769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.884500  5262 tablet_bootstrap.cc:492] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:45.894815  5263 tablet_bootstrap.cc:492] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:45.895713  5130 tablet_service.cc:1511] Processing CreateTablet for tablet b5afebfa702646d8b7372e8562e97d71 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:45.905783  5211 tablet_service.cc:1511] Processing CreateTablet for tablet d4c6522d7db94a48b906c63f7c31b8e6 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:45.907217  5211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c6522d7db94a48b906c63f7c31b8e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.907156  5059 tablet_service.cc:1511] Processing CreateTablet for tablet ffee9280ebbb43bf892976cab5021757 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:45.909806  5209 tablet_service.cc:1511] Processing CreateTablet for tablet 52040c8bb853412eae96ea2727c6f8f5 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:45.911237  5209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52040c8bb853412eae96ea2727c6f8f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.913852  5208 tablet_service.cc:1511] Processing CreateTablet for tablet 500a5a8d445949f0b0d635fd3820f5c9 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:45.917430  5063 tablet_service.cc:1511] Processing CreateTablet for tablet 0bd4cf6677164933b892bc384682a045 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:45.920024  5210 tablet_service.cc:1511] Processing CreateTablet for tablet c872a85641bb42caaf228b2eeeafcc93 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:45.922914  5206 tablet_service.cc:1511] Processing CreateTablet for tablet 8c3c3b60ecf04db989b454ae1f760212 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:45.927099  5204 tablet_service.cc:1511] Processing CreateTablet for tablet 5b00d99b54ae4fda8d58410ef0b5c3e3 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:45.927906  5207 tablet_service.cc:1511] Processing CreateTablet for tablet d1704f04d7be4e899c5cf5d05207f303 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:45.928993  5135 tablet_service.cc:1511] Processing CreateTablet for tablet 04f60339b6c34e54bbf6e9b4a4c1e54e (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:45.929699  5212 tablet_service.cc:1511] Processing CreateTablet for tablet 9ea368926e6346baa3b0065d3c9c510e (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:45.930253  5135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f60339b6c34e54bbf6e9b4a4c1e54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.932438  5208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 500a5a8d445949f0b0d635fd3820f5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.932168  5205 tablet_service.cc:1511] Processing CreateTablet for tablet 47ebaac790104c1b849ecbeadadc2ac6 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:45.933084  5207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1704f04d7be4e899c5cf5d05207f303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.933807  5205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ebaac790104c1b849ecbeadadc2ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.934460  5206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3c3b60ecf04db989b454ae1f760212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.936872  5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ea368926e6346baa3b0065d3c9c510e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.937557  5210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c872a85641bb42caaf228b2eeeafcc93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.938426  5204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b00d99b54ae4fda8d58410ef0b5c3e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.939457  5203 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1a988a2c4745a2baccff62720af502 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:45.942471  5059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffee9280ebbb43bf892976cab5021757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.943543  5203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1a988a2c4745a2baccff62720af502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.944442  5130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5afebfa702646d8b7372e8562e97d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.950093  5262 tablet_bootstrap.cc:654] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.958276  5056 tablet_service.cc:1511] Processing CreateTablet for tablet 4799f16941ac411c958d31adc8dbd44a (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:45.948078  5133 tablet_service.cc:1511] Processing CreateTablet for tablet 22b25036e425414d9ac336d8b3074769 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:45.961086  5133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b25036e425414d9ac336d8b3074769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.962253  5263 tablet_bootstrap.cc:654] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.952765  5137 tablet_service.cc:1511] Processing CreateTablet for tablet ffee9280ebbb43bf892976cab5021757 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:45.965306  5137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffee9280ebbb43bf892976cab5021757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.967479  5134 tablet_service.cc:1511] Processing CreateTablet for tablet c83bfe7fc28a4548aa8923c761e8108d (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:45.969455  5061 tablet_service.cc:1511] Processing CreateTablet for tablet c83bfe7fc28a4548aa8923c761e8108d (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:45.970827  5061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c83bfe7fc28a4548aa8923c761e8108d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.971392  5057 tablet_service.cc:1511] Processing CreateTablet for tablet 02feac6bfeab4925b7a3a954250788e4 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:45.956338  5136 tablet_service.cc:1511] Processing CreateTablet for tablet 0bd4cf6677164933b892bc384682a045 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:45.971660  5054 tablet_service.cc:1511] Processing CreateTablet for tablet bb629cfc440b4e6f8d2ab3ea5e5cba62 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:45.972465  5063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd4cf6677164933b892bc384682a045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.988875  5056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4799f16941ac411c958d31adc8dbd44a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.990597  5054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb629cfc440b4e6f8d2ab3ea5e5cba62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.978488  5055 tablet_service.cc:1511] Processing CreateTablet for tablet 22a881bcc72945ed82bb9c3b8125ada4 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:45.993625  5055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a881bcc72945ed82bb9c3b8125ada4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:45.993747  5129 tablet_service.cc:1511] Processing CreateTablet for tablet 4799f16941ac411c958d31adc8dbd44a (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:45.997967  5057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02feac6bfeab4925b7a3a954250788e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.004899  5134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c83bfe7fc28a4548aa8923c761e8108d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.005587  5129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4799f16941ac411c958d31adc8dbd44a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.007185  5136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd4cf6677164933b892bc384682a045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.006891  5060 tablet_service.cc:1511] Processing CreateTablet for tablet 45d46b792a2145b79909220733d7a533 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:46.008934  5060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d46b792a2145b79909220733d7a533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.032475  5138 tablet_service.cc:1511] Processing CreateTablet for tablet 02feac6bfeab4925b7a3a954250788e4 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:46.045878  5058 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac38dc58d75468593dee0edaafb81c9 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:46.047246  5058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac38dc58d75468593dee0edaafb81c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.048038  5138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02feac6bfeab4925b7a3a954250788e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.024363  5062 tablet_service.cc:1511] Processing CreateTablet for tablet f8da98a042af4ca9ac0ae86911498913 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:46.052969  5063 tablet_service.cc:1511] Processing CreateTablet for tablet ec76d9e7afeb4c04b652649a01ebdc52 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:46.059636  5062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8da98a042af4ca9ac0ae86911498913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.065048  5059 tablet_service.cc:1511] Processing CreateTablet for tablet 73298cac061840a88d6e43468fbb541d (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:46.066424  5059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73298cac061840a88d6e43468fbb541d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.077795  5062 tablet_service.cc:1511] Processing CreateTablet for tablet 4eed62f347644556a405f7e6991cebf7 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:46.079170  5062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eed62f347644556a405f7e6991cebf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.086781  5059 tablet_service.cc:1511] Processing CreateTablet for tablet d1640ee2f62349858037e353ecde48d8 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:46.088303  5059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1640ee2f62349858037e353ecde48d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.093350  5063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec76d9e7afeb4c04b652649a01ebdc52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.108711  5059 tablet_service.cc:1511] Processing CreateTablet for tablet f6812f3677044ecba0f8e57690bef590 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:46.110375  5059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6812f3677044ecba0f8e57690bef590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.110126  5210 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac38dc58d75468593dee0edaafb81c9 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:46.111460  5210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac38dc58d75468593dee0edaafb81c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.119742  5207 tablet_service.cc:1511] Processing CreateTablet for tablet 56941204ae3e40bba5254fad3092ebeb (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:46.121634  5206 tablet_service.cc:1511] Processing CreateTablet for tablet 04f60339b6c34e54bbf6e9b4a4c1e54e (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:46.125031  5205 tablet_service.cc:1511] Processing CreateTablet for tablet b5afebfa702646d8b7372e8562e97d71 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:46.129679  5131 tablet_service.cc:1511] Processing CreateTablet for tablet bb629cfc440b4e6f8d2ab3ea5e5cba62 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
W20260709 12:25:46.135079  5018 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:46.164827  5262 tablet_bootstrap.cc:492] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:46.165331  5262 ts_tablet_manager.cc:1403] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.281s	user 0.010s	sys 0.006s
I20260709 12:25:46.166136  5203 tablet_service.cc:1511] Processing CreateTablet for tablet ffee9280ebbb43bf892976cab5021757 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:46.167410  5203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffee9280ebbb43bf892976cab5021757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.167783  5131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb629cfc440b4e6f8d2ab3ea5e5cba62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.168123  5262 raft_consensus.cc:359] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.168982  5262 raft_consensus.cc:385] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.169293  5262 raft_consensus.cc:740] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.169503  5265 tablet_bootstrap.cc:492] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:46.170185  5262 consensus_queue.cc:260] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.175401  5265 tablet_bootstrap.cc:654] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.177212  5211 tablet_service.cc:1511] Processing CreateTablet for tablet 22b25036e425414d9ac336d8b3074769 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:46.178496  5211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b25036e425414d9ac336d8b3074769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.178732  5204 tablet_service.cc:1511] Processing CreateTablet for tablet c83bfe7fc28a4548aa8923c761e8108d (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:46.179932  5204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c83bfe7fc28a4548aa8923c761e8108d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.183126  5212 tablet_service.cc:1511] Processing CreateTablet for tablet 4799f16941ac411c958d31adc8dbd44a (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:46.185968  5132 tablet_service.cc:1511] Processing CreateTablet for tablet 45d46b792a2145b79909220733d7a533 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:46.186664  5208 tablet_service.cc:1511] Processing CreateTablet for tablet 0bd4cf6677164933b892bc384682a045 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:46.191623  5133 tablet_service.cc:1511] Processing CreateTablet for tablet 22a881bcc72945ed82bb9c3b8125ada4 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:46.194314  5209 tablet_service.cc:1511] Processing CreateTablet for tablet 02feac6bfeab4925b7a3a954250788e4 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:46.197731  5130 tablet_service.cc:1511] Processing CreateTablet for tablet f8da98a042af4ca9ac0ae86911498913 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:46.200762  5130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8da98a042af4ca9ac0ae86911498913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.189296  5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4799f16941ac411c958d31adc8dbd44a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.213661  5138 tablet_service.cc:1511] Processing CreateTablet for tablet ec76d9e7afeb4c04b652649a01ebdc52 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:46.207572  5132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d46b792a2145b79909220733d7a533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.223485  5262 ts_tablet_manager.cc:1434] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.005s
I20260709 12:25:46.224618  5262 tablet_bootstrap.cc:492] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:46.224334  5098 heartbeater.cc:499] Master 127.3.200.126:42719 was elected leader, sending a full tablet report...
I20260709 12:25:46.213610  5054 tablet_service.cc:1511] Processing CreateTablet for tablet b10627fec43d464e94516d46e5afc694 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:46.228252  5054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10627fec43d464e94516d46e5afc694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.230593  5133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a881bcc72945ed82bb9c3b8125ada4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.233273  5263 tablet_bootstrap.cc:492] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:46.233784  5263 ts_tablet_manager.cc:1403] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.339s	user 0.011s	sys 0.011s
I20260709 12:25:46.222272  5209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02feac6bfeab4925b7a3a954250788e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.237290  5206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f60339b6c34e54bbf6e9b4a4c1e54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.237896  5207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56941204ae3e40bba5254fad3092ebeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.233069  5129 tablet_service.cc:1511] Processing CreateTablet for tablet 4eed62f347644556a405f7e6991cebf7 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:46.238555  5205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5afebfa702646d8b7372e8562e97d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.240370  5208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd4cf6677164933b892bc384682a045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.247063  5056 tablet_service.cc:1511] Processing CreateTablet for tablet cdc3c77d7a1a4a4c9cf2c6405234815d (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:46.248749  5263 raft_consensus.cc:359] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.249497  5263 raft_consensus.cc:385] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.249799  5263 raft_consensus.cc:740] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.250546  5263 consensus_queue.cc:260] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.251802  5057 tablet_service.cc:1511] Processing CreateTablet for tablet f3892e26d8f94adabf8bd2581fee782b (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:46.248387  5056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdc3c77d7a1a4a4c9cf2c6405234815d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.248764  5138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec76d9e7afeb4c04b652649a01ebdc52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.253353  5267 raft_consensus.cc:493] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.224118  5136 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac38dc58d75468593dee0edaafb81c9 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:46.271166  5061 tablet_service.cc:1511] Processing CreateTablet for tablet 7292f06cb5514a80849fe386d1f5edd5 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:46.266479  5267 raft_consensus.cc:515] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.278942  5055 tablet_service.cc:1511] Processing CreateTablet for tablet 4c62b8870a024d5692b8e8b85185dbd6 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:46.281260  5136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac38dc58d75468593dee0edaafb81c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.281749  5134 tablet_service.cc:1511] Processing CreateTablet for tablet d1640ee2f62349858037e353ecde48d8 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:46.283425  5134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1640ee2f62349858037e353ecde48d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.285364  5135 tablet_service.cc:1511] Processing CreateTablet for tablet 73298cac061840a88d6e43468fbb541d (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:46.287055  5135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73298cac061840a88d6e43468fbb541d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.297113  5129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eed62f347644556a405f7e6991cebf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.297900  5173 heartbeater.cc:499] Master 127.3.200.126:42719 was elected leader, sending a full tablet report...
I20260709 12:25:46.293870  5057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3892e26d8f94adabf8bd2581fee782b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.307545  5059 tablet_service.cc:1511] Processing CreateTablet for tablet 6ada8dc88d254884a47e7eb4f7f18244 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:46.308612  5265 tablet_bootstrap.cc:492] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:46.309105  5265 ts_tablet_manager.cc:1403] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.140s	user 0.010s	sys 0.006s
I20260709 12:25:46.317154  5267 leader_election.cc:290] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:46.318390  5137 tablet_service.cc:1511] Processing CreateTablet for tablet f6812f3677044ecba0f8e57690bef590 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:46.319801  5137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6812f3677044ecba0f8e57690bef590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.321041  5059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ada8dc88d254884a47e7eb4f7f18244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.321659  5055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c62b8870a024d5692b8e8b85185dbd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.327024  5211 tablet_service.cc:1511] Processing CreateTablet for tablet 22a881bcc72945ed82bb9c3b8125ada4 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:46.329540  5265 raft_consensus.cc:359] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.338343  5265 raft_consensus.cc:385] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.338799  5265 raft_consensus.cc:740] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.339977  5265 consensus_queue.cc:260] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.340740  5061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7292f06cb5514a80849fe386d1f5edd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.345254  5210 tablet_service.cc:1511] Processing CreateTablet for tablet bb629cfc440b4e6f8d2ab3ea5e5cba62 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:46.347132  5210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb629cfc440b4e6f8d2ab3ea5e5cba62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.352514  5203 tablet_service.cc:1511] Processing CreateTablet for tablet 45d46b792a2145b79909220733d7a533 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:46.353969  5203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d46b792a2145b79909220733d7a533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.357403  5263 ts_tablet_manager.cc:1434] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.123s	user 0.018s	sys 0.027s
I20260709 12:25:46.358681  5263 tablet_bootstrap.cc:492] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:46.391060  5212 tablet_service.cc:1511] Processing CreateTablet for tablet ec76d9e7afeb4c04b652649a01ebdc52 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:46.414338  5060 tablet_service.cc:1511] Processing CreateTablet for tablet e5b732ffbeea492c9c4d91376c781263 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:46.415688  5060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b732ffbeea492c9c4d91376c781263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.401502  5208 tablet_service.cc:1511] Processing CreateTablet for tablet f8da98a042af4ca9ac0ae86911498913 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:46.422022  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1704f04d7be4e899c5cf5d05207f303" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
W20260709 12:25:46.424641  5037 leader_election.cc:343] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:46.404647  5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec76d9e7afeb4c04b652649a01ebdc52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.426610  5211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a881bcc72945ed82bb9c3b8125ada4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.437235  5133 tablet_service.cc:1511] Processing CreateTablet for tablet f3892e26d8f94adabf8bd2581fee782b (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:46.437885  5208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8da98a042af4ca9ac0ae86911498913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.439262  5132 tablet_service.cc:1511] Processing CreateTablet for tablet cdc3c77d7a1a4a4c9cf2c6405234815d (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:46.441160  5132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdc3c77d7a1a4a4c9cf2c6405234815d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.445448  5269 raft_consensus.cc:493] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.445947  5269 raft_consensus.cc:515] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.446964  5059 tablet_service.cc:1511] Processing CreateTablet for tablet f424fe8428004213860887c1e4ed5796 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:46.448273  5059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f424fe8428004213860887c1e4ed5796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.449218  5133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3892e26d8f94adabf8bd2581fee782b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.403486  5262 tablet_bootstrap.cc:654] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.479809  5129 tablet_service.cc:1511] Processing CreateTablet for tablet 7292f06cb5514a80849fe386d1f5edd5 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:46.454185  5269 leader_election.cc:290] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:46.505477  5265 ts_tablet_manager.cc:1434] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.196s	user 0.028s	sys 0.030s
I20260709 12:25:46.512342  5247 heartbeater.cc:499] Master 127.3.200.126:42719 was elected leader, sending a full tablet report...
I20260709 12:25:46.518465  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1704f04d7be4e899c5cf5d05207f303" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:46.518862  5265 tablet_bootstrap.cc:492] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:46.491217  5135 tablet_service.cc:1511] Processing CreateTablet for tablet b10627fec43d464e94516d46e5afc694 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260709 12:25:46.520224  5039 leader_election.cc:343] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:46.520733  5039 leader_election.cc:304] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:46.521515  5267 raft_consensus.cc:2749] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:46.536177  5211 tablet_service.cc:1511] Processing CreateTablet for tablet 73298cac061840a88d6e43468fbb541d (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:46.537643  5211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73298cac061840a88d6e43468fbb541d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.541465  5265 tablet_bootstrap.cc:654] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.543677  5212 tablet_service.cc:1511] Processing CreateTablet for tablet 4eed62f347644556a405f7e6991cebf7 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:46.555085  5131 tablet_service.cc:1511] Processing CreateTablet for tablet 4c62b8870a024d5692b8e8b85185dbd6 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:46.557873  5206 tablet_service.cc:1511] Processing CreateTablet for tablet f6812f3677044ecba0f8e57690bef590 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:46.558198  5138 tablet_service.cc:1511] Processing CreateTablet for tablet 6ada8dc88d254884a47e7eb4f7f18244 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:46.556420  5131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c62b8870a024d5692b8e8b85185dbd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.565704  5263 tablet_bootstrap.cc:654] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.564013  5210 tablet_service.cc:1511] Processing CreateTablet for tablet b10627fec43d464e94516d46e5afc694 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:46.567085  5135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10627fec43d464e94516d46e5afc694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.545004  5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eed62f347644556a405f7e6991cebf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.574028  5129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7292f06cb5514a80849fe386d1f5edd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.575665  5136 tablet_service.cc:1511] Processing CreateTablet for tablet e5b732ffbeea492c9c4d91376c781263 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:46.576666  5138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ada8dc88d254884a47e7eb4f7f18244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.578477  5054 tablet_service.cc:1511] Processing CreateTablet for tablet f863b6a5fcc24d979cc005aaef6827ae (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:46.579231  5057 tablet_service.cc:1511] Processing CreateTablet for tablet b34eeef728364ce7a688984bb7fbbb91 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:46.579753  5054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f863b6a5fcc24d979cc005aaef6827ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.580428  5057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b34eeef728364ce7a688984bb7fbbb91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.581722  5061 tablet_service.cc:1511] Processing CreateTablet for tablet ee33af6c31104d4abfff69a578ddc361 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:46.583235  5061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee33af6c31104d4abfff69a578ddc361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.583820  5205 tablet_service.cc:1511] Processing CreateTablet for tablet d1640ee2f62349858037e353ecde48d8 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:46.567118  5204 tablet_service.cc:1511] Processing CreateTablet for tablet cdc3c77d7a1a4a4c9cf2c6405234815d (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:46.584667  5130 tablet_service.cc:1511] Processing CreateTablet for tablet f424fe8428004213860887c1e4ed5796 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:46.589452  5134 tablet_service.cc:1511] Processing CreateTablet for tablet f863b6a5fcc24d979cc005aaef6827ae (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:46.592612  5206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6812f3677044ecba0f8e57690bef590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.605423  5210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10627fec43d464e94516d46e5afc694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.620173  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00d99b54ae4fda8d58410ef0b5c3e3" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:46.623188  5136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b732ffbeea492c9c4d91376c781263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.623971  5204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdc3c77d7a1a4a4c9cf2c6405234815d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.624647  5205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1640ee2f62349858037e353ecde48d8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:46.623077  5114 leader_election.cc:343] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:46.634500  4957 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 45497.1us
I20260709 12:25:46.642942  5133 tablet_service.cc:1511] Processing CreateTablet for tablet ee33af6c31104d4abfff69a578ddc361 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:46.647086  5262 tablet_bootstrap.cc:492] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:46.647584  5262 ts_tablet_manager.cc:1403] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.423s	user 0.010s	sys 0.005s
I20260709 12:25:46.649793  5273 raft_consensus.cc:493] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.650306  5273 raft_consensus.cc:515] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.655128  5134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f863b6a5fcc24d979cc005aaef6827ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.664899  5209 tablet_service.cc:1511] Processing CreateTablet for tablet f3892e26d8f94adabf8bd2581fee782b (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:46.666275  5209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3892e26d8f94adabf8bd2581fee782b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.653223  5207 tablet_service.cc:1511] Processing CreateTablet for tablet 7292f06cb5514a80849fe386d1f5edd5 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:46.668749  5130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f424fe8428004213860887c1e4ed5796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.669620  5207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7292f06cb5514a80849fe386d1f5edd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.671213  5055 tablet_service.cc:1511] Processing CreateTablet for tablet 23c924d344cb49639d42d3f21aa08cf2 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:46.675683  5273 leader_election.cc:290] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:46.682065  5133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee33af6c31104d4abfff69a578ddc361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.690429  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00d99b54ae4fda8d58410ef0b5c3e3" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
W20260709 12:25:46.692658  5113 leader_election.cc:343] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:46.693290  5113 leader_election.cc:304] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:46.684432  5055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23c924d344cb49639d42d3f21aa08cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.696511  5269 raft_consensus.cc:2749] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:46.705552  5129 tablet_service.cc:1511] Processing CreateTablet for tablet b34eeef728364ce7a688984bb7fbbb91 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:46.707020  5208 tablet_service.cc:1511] Processing CreateTablet for tablet 4c62b8870a024d5692b8e8b85185dbd6 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:46.708390  5208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c62b8870a024d5692b8e8b85185dbd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.712673  5263 tablet_bootstrap.cc:492] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:46.713191  5263 ts_tablet_manager.cc:1403] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.355s	user 0.011s	sys 0.005s
I20260709 12:25:46.716087  5263 raft_consensus.cc:359] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.716815  5263 raft_consensus.cc:385] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.717087  5263 raft_consensus.cc:740] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.717388  5262 raft_consensus.cc:359] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.717883  5263 consensus_queue.cc:260] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.721261  5263 ts_tablet_manager.cc:1434] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:46.718102  5262 raft_consensus.cc:385] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.721848  5262 raft_consensus.cc:740] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.722533  5262 consensus_queue.cc:260] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.730149  5262 ts_tablet_manager.cc:1434] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.001s
I20260709 12:25:46.730511  5129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b34eeef728364ce7a688984bb7fbbb91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.734963  5262 tablet_bootstrap.cc:492] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:46.726655  5203 tablet_service.cc:1511] Processing CreateTablet for tablet 6ada8dc88d254884a47e7eb4f7f18244 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:46.731139  5263 tablet_bootstrap.cc:492] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:46.741413  5203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ada8dc88d254884a47e7eb4f7f18244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.747088  5263 tablet_bootstrap.cc:654] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.751264  5262 tablet_bootstrap.cc:654] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.754190  5265 tablet_bootstrap.cc:492] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:46.756194  5212 tablet_service.cc:1511] Processing CreateTablet for tablet e5b732ffbeea492c9c4d91376c781263 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:46.762374  5265 ts_tablet_manager.cc:1403] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.244s	user 0.019s	sys 0.028s
W20260709 12:25:46.769807  4956 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 81997.3us
W20260709 12:25:46.770009  4958 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 47887.2us
I20260709 12:25:46.779964  5265 raft_consensus.cc:359] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.773190  5210 tablet_service.cc:1511] Processing CreateTablet for tablet f424fe8428004213860887c1e4ed5796 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:46.776988  5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b732ffbeea492c9c4d91376c781263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.790302  5054 tablet_service.cc:1511] Processing CreateTablet for tablet 97e28bbe53df40bda7a921f79ae0514f (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:46.776371  5208 tablet_service.cc:1511] Processing CreateTablet for tablet f863b6a5fcc24d979cc005aaef6827ae (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:46.792970  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500a5a8d445949f0b0d635fd3820f5c9" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:46.806775  5054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e28bbe53df40bda7a921f79ae0514f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.800257  5265 raft_consensus.cc:385] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.793035  5135 tablet_service.cc:1511] Processing CreateTablet for tablet 23c924d344cb49639d42d3f21aa08cf2 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:46.810588  5135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23c924d344cb49639d42d3f21aa08cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.814225  5132 tablet_service.cc:1511] Processing CreateTablet for tablet 04afa18a0a324c0d9788a17d1182585b (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:46.815529  5132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04afa18a0a324c0d9788a17d1182585b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.815326  5129 tablet_service.cc:1511] Processing CreateTablet for tablet 97e28bbe53df40bda7a921f79ae0514f (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:46.816543  5129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e28bbe53df40bda7a921f79ae0514f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.822372  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500a5a8d445949f0b0d635fd3820f5c9" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:46.822556  5057 tablet_service.cc:1511] Processing CreateTablet for tablet 253cc4e85c5b4c18ac746b32b0a47e47 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 12:25:46.823583  5186 leader_election.cc:343] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:46.823854  5057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253cc4e85c5b4c18ac746b32b0a47e47. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:46.824215  5187 leader_election.cc:343] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:46.824641  5187 leader_election.cc:304] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:46.825505  5273 raft_consensus.cc:2749] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:46.827483  5061 tablet_service.cc:1511] Processing CreateTablet for tablet 04afa18a0a324c0d9788a17d1182585b (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:46.828811  5061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04afa18a0a324c0d9788a17d1182585b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.834607  5206 tablet_service.cc:1511] Processing CreateTablet for tablet ee33af6c31104d4abfff69a578ddc361 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:46.837353  5138 tablet_service.cc:1511] Processing CreateTablet for tablet 253cc4e85c5b4c18ac746b32b0a47e47 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:46.844156  5138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253cc4e85c5b4c18ac746b32b0a47e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.845484  5263 tablet_bootstrap.cc:492] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:46.852504  5204 tablet_service.cc:1511] Processing CreateTablet for tablet 23c924d344cb49639d42d3f21aa08cf2 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:46.809247  5265 raft_consensus.cc:740] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.848385  5208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f863b6a5fcc24d979cc005aaef6827ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.853830  5204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23c924d344cb49639d42d3f21aa08cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.850178  5205 tablet_service.cc:1511] Processing CreateTablet for tablet b34eeef728364ce7a688984bb7fbbb91 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:46.856953  5209 tablet_service.cc:1511] Processing CreateTablet for tablet 04afa18a0a324c0d9788a17d1182585b (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:46.850180  5262 tablet_bootstrap.cc:492] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:46.861048  5262 ts_tablet_manager.cc:1403] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.000s
I20260709 12:25:46.853909  5211 tablet_service.cc:1511] Processing CreateTablet for tablet 97e28bbe53df40bda7a921f79ae0514f (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:46.854756  5206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee33af6c31104d4abfff69a578ddc361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.865355  5265 consensus_queue.cc:260] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.866359  5205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b34eeef728364ce7a688984bb7fbbb91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.868167  5055 tablet_service.cc:1511] Processing CreateTablet for tablet 4f9c81422e73491dba294f24607e5e84 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:46.869520  5055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f9c81422e73491dba294f24607e5e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.873212  5210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f424fe8428004213860887c1e4ed5796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.875705  5134 tablet_service.cc:1511] Processing CreateTablet for tablet 2f147c4f5ae9479dae2779366c7cf2fe (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:46.876981  5211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e28bbe53df40bda7a921f79ae0514f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.877365  5134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f147c4f5ae9479dae2779366c7cf2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.880911  5209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04afa18a0a324c0d9788a17d1182585b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.852977  5263 ts_tablet_manager.cc:1403] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.122s	user 0.012s	sys 0.005s
I20260709 12:25:46.881582  5136 tablet_service.cc:1511] Processing CreateTablet for tablet 4f9c81422e73491dba294f24607e5e84 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:46.864171  5262 raft_consensus.cc:359] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.885955  5262 raft_consensus.cc:385] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.886351  5262 raft_consensus.cc:740] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.884131  5207 tablet_service.cc:1511] Processing CreateTablet for tablet 4f9c81422e73491dba294f24607e5e84 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:46.888253  5054 tablet_service.cc:1511] Processing CreateTablet for tablet 2f147c4f5ae9479dae2779366c7cf2fe (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:46.889545  5054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f147c4f5ae9479dae2779366c7cf2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.890189  5265 ts_tablet_manager.cc:1434] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.113s	user 0.006s	sys 0.001s
I20260709 12:25:46.867297  5203 tablet_service.cc:1511] Processing CreateTablet for tablet 253cc4e85c5b4c18ac746b32b0a47e47 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:46.893565  5136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f9c81422e73491dba294f24607e5e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.903299  5207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f9c81422e73491dba294f24607e5e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.913055  5265 tablet_bootstrap.cc:492] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:46.915750  5263 raft_consensus.cc:359] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.916607  5263 raft_consensus.cc:385] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.916955  5263 raft_consensus.cc:740] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.917258  5056 tablet_service.cc:1511] Processing CreateTablet for tablet d650634415db46289a46381b54dde329 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:46.918551  5056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d650634415db46289a46381b54dde329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.919421  5263 consensus_queue.cc:260] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.922670  5203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253cc4e85c5b4c18ac746b32b0a47e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.908859  5262 consensus_queue.cc:260] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:46.928323  5130 tablet_service.cc:1511] Processing CreateTablet for tablet d650634415db46289a46381b54dde329 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:46.930327  5130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d650634415db46289a46381b54dde329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.930476  5262 ts_tablet_manager.cc:1434] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.001s
I20260709 12:25:46.937085  5133 tablet_service.cc:1511] Processing CreateTablet for tablet 89a90aff4ede48ad8c6ef5d2ca6c1a5c (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:46.938359  5133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a90aff4ede48ad8c6ef5d2ca6c1a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.941560  5059 tablet_service.cc:1511] Processing CreateTablet for tablet 07469c82367d44f58e1a33659fefd477 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:46.944005  5137 tablet_service.cc:1511] Processing CreateTablet for tablet 07469c82367d44f58e1a33659fefd477 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:46.945309  5137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07469c82367d44f58e1a33659fefd477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.928340  5212 tablet_service.cc:1511] Processing CreateTablet for tablet 2f147c4f5ae9479dae2779366c7cf2fe (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:46.951592  5212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f147c4f5ae9479dae2779366c7cf2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.966827  5059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07469c82367d44f58e1a33659fefd477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.972039  5057 tablet_service.cc:1511] Processing CreateTablet for tablet 89a90aff4ede48ad8c6ef5d2ca6c1a5c (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:46.973452  5204 tablet_service.cc:1511] Processing CreateTablet for tablet d650634415db46289a46381b54dde329 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:46.996826  5055 tablet_service.cc:1511] Processing CreateTablet for tablet 3f70fcd244ec422c887a45f476de45f1 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:46.997964  5204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d650634415db46289a46381b54dde329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.998044  5055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f70fcd244ec422c887a45f476de45f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.975540  5205 tablet_service.cc:1511] Processing CreateTablet for tablet 89a90aff4ede48ad8c6ef5d2ca6c1a5c (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:47.001307  5205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a90aff4ede48ad8c6ef5d2ca6c1a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.979751  5262 tablet_bootstrap.cc:492] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:46.981604  5267 raft_consensus.cc:493] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.005242  5057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a90aff4ede48ad8c6ef5d2ca6c1a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.005023  5267 raft_consensus.cc:515] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.005909  5135 tablet_service.cc:1511] Processing CreateTablet for tablet 3f70fcd244ec422c887a45f476de45f1 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:47.007735  5135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f70fcd244ec422c887a45f476de45f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.010906  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52040c8bb853412eae96ea2727c6f8f5" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:47.011229  5265 tablet_bootstrap.cc:654] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.011596  5148 raft_consensus.cc:2468] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:47.014655  5037 leader_election.cc:304] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:47.015667  5267 leader_election.cc:290] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:47.016258  5267 raft_consensus.cc:2804] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:47.016697  5267 raft_consensus.cc:493] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.017306  5267 raft_consensus.cc:3060] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.020402  5060 tablet_service.cc:1511] Processing CreateTablet for tablet a3a3a987e8c145f484b2c0aa9890ed20 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:47.021854  5060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3a3a987e8c145f484b2c0aa9890ed20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.024756  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52040c8bb853412eae96ea2727c6f8f5" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
W20260709 12:25:47.026283  5039 leader_election.cc:343] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.026350  5207 tablet_service.cc:1511] Processing CreateTablet for tablet 3f70fcd244ec422c887a45f476de45f1 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:47.027647  5273 raft_consensus.cc:493] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.028164  5273 raft_consensus.cc:515] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.030385  5273 leader_election.cc:290] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:47.032179  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ebaac790104c1b849ecbeadadc2ac6" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
W20260709 12:25:47.033691  5187 leader_election.cc:343] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.034714  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ebaac790104c1b849ecbeadadc2ac6" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:47.035410  5148 raft_consensus.cc:2468] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:47.036791  5186 leader_election.cc:304] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:25:47.037657  5273 raft_consensus.cc:2804] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:47.038019  5273 raft_consensus.cc:493] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.038370  5273 raft_consensus.cc:3060] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.038748  5138 tablet_service.cc:1511] Processing CreateTablet for tablet a3a3a987e8c145f484b2c0aa9890ed20 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:47.040186  5138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3a3a987e8c145f484b2c0aa9890ed20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:46.976222  5263 ts_tablet_manager.cc:1434] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.001s
I20260709 12:25:47.046687  5263 tablet_bootstrap.cc:492] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:47.057904  5056 tablet_service.cc:1511] Processing CreateTablet for tablet 5d91e17c8c3b4cac9a128316050ce7df (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:47.059362  5056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d91e17c8c3b4cac9a128316050ce7df. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:47.059551  5037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 44992.9us
I20260709 12:25:47.048871  5208 tablet_service.cc:1511] Processing CreateTablet for tablet 07469c82367d44f58e1a33659fefd477 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:47.027817  5207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f70fcd244ec422c887a45f476de45f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.052989  5265 tablet_bootstrap.cc:492] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:47.046720  5273 raft_consensus.cc:515] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.061641  5265 ts_tablet_manager.cc:1403] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.171s	user 0.012s	sys 0.003s
I20260709 12:25:47.064015  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ebaac790104c1b849ecbeadadc2ac6" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:47.064898  5208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07469c82367d44f58e1a33659fefd477. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:47.065536  5187 leader_election.cc:343] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.066601  5265 raft_consensus.cc:359] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.067338  5265 raft_consensus.cc:385] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.067641  5265 raft_consensus.cc:740] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.067675  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ebaac790104c1b849ecbeadadc2ac6" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:47.068324  5148 raft_consensus.cc:3060] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.068651  5265 consensus_queue.cc:260] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.073048  5203 tablet_service.cc:1511] Processing CreateTablet for tablet 5d91e17c8c3b4cac9a128316050ce7df (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:47.074380  5203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d91e17c8c3b4cac9a128316050ce7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.076001  5148 raft_consensus.cc:2468] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:47.077282  5186 leader_election.cc:304] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:25:47.082044  5130 tablet_service.cc:1511] Processing CreateTablet for tablet 5d91e17c8c3b4cac9a128316050ce7df (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:47.083506  5130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d91e17c8c3b4cac9a128316050ce7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.049705  5206 tablet_service.cc:1511] Processing CreateTablet for tablet a3a3a987e8c145f484b2c0aa9890ed20 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:47.091024  5206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3a3a987e8c145f484b2c0aa9890ed20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.098500  5060 tablet_service.cc:1511] Processing CreateTablet for tablet 034ac3e487504f54ac6e50430a0b22d7 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:47.100756  5060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 034ac3e487504f54ac6e50430a0b22d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.089677  5267 raft_consensus.cc:515] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.114233  5263 tablet_bootstrap.cc:654] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.115104  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52040c8bb853412eae96ea2727c6f8f5" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:47.115335  5267 leader_election.cc:290] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:47.101402  5137 tablet_service.cc:1511] Processing CreateTablet for tablet 034ac3e487504f54ac6e50430a0b22d7 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:47.115767  5148 raft_consensus.cc:3060] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.116711  5137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 034ac3e487504f54ac6e50430a0b22d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.122598  5055 tablet_service.cc:1511] Processing CreateTablet for tablet 3a00dc8dae764febafe0efdc0fadcdac (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:47.125036  5055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a00dc8dae764febafe0efdc0fadcdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.125665  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52040c8bb853412eae96ea2727c6f8f5" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
W20260709 12:25:47.127252  5039 leader_election.cc:343] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.102665  5273 leader_election.cc:290] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:47.127732  5130 tablet_service.cc:1511] Processing CreateTablet for tablet 3a00dc8dae764febafe0efdc0fadcdac (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:47.098212  5262 tablet_bootstrap.cc:654] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.129006  5130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a00dc8dae764febafe0efdc0fadcdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.130834  5209 tablet_service.cc:1511] Processing CreateTablet for tablet 034ac3e487504f54ac6e50430a0b22d7 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:47.134006  5209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 034ac3e487504f54ac6e50430a0b22d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.108574  5288 raft_consensus.cc:493] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.140993  5288 raft_consensus.cc:515] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.147537  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c872a85641bb42caaf228b2eeeafcc93" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
W20260709 12:25:47.149513  5187 leader_election.cc:343] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.127322  5265 ts_tablet_manager.cc:1434] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.001s
I20260709 12:25:47.153687  5265 tablet_bootstrap.cc:492] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:47.153525  5054 tablet_service.cc:1511] Processing CreateTablet for tablet ccce9c827ef54c7fa65928fda3eb7acf (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:47.154943  5054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccce9c827ef54c7fa65928fda3eb7acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.107823  5289 raft_consensus.cc:2804] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:47.142596  5204 tablet_service.cc:1511] Processing CreateTablet for tablet 3a00dc8dae764febafe0efdc0fadcdac (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:47.158818  5204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a00dc8dae764febafe0efdc0fadcdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.159251  5133 tablet_service.cc:1511] Processing CreateTablet for tablet ccce9c827ef54c7fa65928fda3eb7acf (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:47.160490  5133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccce9c827ef54c7fa65928fda3eb7acf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:47.165531  5018 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:47.167780  5205 tablet_service.cc:1511] Processing CreateTablet for tablet ccce9c827ef54c7fa65928fda3eb7acf (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:47.165573  5289 raft_consensus.cc:697] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:25:47.169100  5205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccce9c827ef54c7fa65928fda3eb7acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.169505  5289 consensus_queue.cc:237] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.171280  5136 tablet_service.cc:1511] Processing CreateTablet for tablet 8f0b7d7401864a6cadec140ae4603df6 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:47.173311  5136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f0b7d7401864a6cadec140ae4603df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.175683  5203 tablet_service.cc:1511] Processing CreateTablet for tablet 8f0b7d7401864a6cadec140ae4603df6 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 12:25:47.172377  5174 tablet.cc:2406] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:47.176928  5203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f0b7d7401864a6cadec140ae4603df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.181317  5060 tablet_service.cc:1511] Processing CreateTablet for tablet 8f0b7d7401864a6cadec140ae4603df6 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:47.182614  5060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f0b7d7401864a6cadec140ae4603df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.185976  5148 raft_consensus.cc:2468] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:47.187211  5037 leader_election.cc:304] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:47.188423  5267 raft_consensus.cc:2804] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:47.188952  5267 raft_consensus.cc:697] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:47.189803  5267 consensus_queue.cc:237] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.200480  5056 tablet_service.cc:1511] Processing CreateTablet for tablet 1838a7c5a8e448ff84f311a659312dff (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:47.201874  5056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1838a7c5a8e448ff84f311a659312dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.203605  5138 tablet_service.cc:1511] Processing CreateTablet for tablet 1838a7c5a8e448ff84f311a659312dff (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:47.204879  5138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1838a7c5a8e448ff84f311a659312dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.210404  5288 leader_election.cc:290] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:47.220177  5265 tablet_bootstrap.cc:654] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.224026  5204 tablet_service.cc:1511] Processing CreateTablet for tablet 1838a7c5a8e448ff84f311a659312dff (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:47.221151  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c872a85641bb42caaf228b2eeeafcc93" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:47.225432  5204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1838a7c5a8e448ff84f311a659312dff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:47.225782  5186 leader_election.cc:343] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.226264  5186 leader_election.cc:304] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:47.226065  4969 catalog_manager.cc:5697] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:47.227669  5289 raft_consensus.cc:2749] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:47.251935  5203 tablet_service.cc:1511] Processing CreateTablet for tablet 2ebf5bf87e474e0fbdecf20901b28622 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:47.253409  5054 tablet_service.cc:1511] Processing CreateTablet for tablet c89d4eb4d7d548c88dc21b8bafee287e (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:47.253446  5203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebf5bf87e474e0fbdecf20901b28622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.254735  5054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89d4eb4d7d548c88dc21b8bafee287e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.257642  5133 tablet_service.cc:1511] Processing CreateTablet for tablet c89d4eb4d7d548c88dc21b8bafee287e (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:47.257386  4971 catalog_manager.cc:5697] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:47.258854  5133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89d4eb4d7d548c88dc21b8bafee287e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.257395  5055 tablet_service.cc:1511] Processing CreateTablet for tablet 2ebf5bf87e474e0fbdecf20901b28622 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:47.261421  5055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebf5bf87e474e0fbdecf20901b28622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.261598  5136 tablet_service.cc:1511] Processing CreateTablet for tablet 2ebf5bf87e474e0fbdecf20901b28622 (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:47.262845  5136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebf5bf87e474e0fbdecf20901b28622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.273093  5206 tablet_service.cc:1511] Processing CreateTablet for tablet c89d4eb4d7d548c88dc21b8bafee287e (DEFAULT_TABLE table=test-workload [id=bc9b417720e34db6b58b94c1899dd692]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:47.274814  5206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89d4eb4d7d548c88dc21b8bafee287e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:47.290216  5262 tablet_bootstrap.cc:492] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:47.290755  5262 ts_tablet_manager.cc:1403] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.311s	user 0.010s	sys 0.009s
I20260709 12:25:47.308158  5262 raft_consensus.cc:359] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.309092  5262 raft_consensus.cc:385] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.309475  5262 raft_consensus.cc:740] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.309583  5263 tablet_bootstrap.cc:492] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:47.310184  5263 ts_tablet_manager.cc:1403] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.264s	user 0.030s	sys 0.034s
I20260709 12:25:47.313278  5265 tablet_bootstrap.cc:492] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:47.313128  5263 raft_consensus.cc:359] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.313791  5265 ts_tablet_manager.cc:1403] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.160s	user 0.014s	sys 0.008s
I20260709 12:25:47.313975  5263 raft_consensus.cc:385] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.314407  5263 raft_consensus.cc:740] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.316679  5265 raft_consensus.cc:359] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.317448  5265 raft_consensus.cc:385] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.317785  5265 raft_consensus.cc:740] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.317631  5263 consensus_queue.cc:260] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.318519  5265 consensus_queue.cc:260] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.315549  5262 consensus_queue.cc:260] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.326089  5263 ts_tablet_manager.cc:1434] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:25:47.327155  5263 tablet_bootstrap.cc:492] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:47.327961  5265 ts_tablet_manager.cc:1434] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:25:47.328931  5262 ts_tablet_manager.cc:1434] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.002s
I20260709 12:25:47.329319  5265 tablet_bootstrap.cc:492] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:47.330070  5262 tablet_bootstrap.cc:492] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:47.333380  5263 tablet_bootstrap.cc:654] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.337387  5265 tablet_bootstrap.cc:654] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.338040  5262 tablet_bootstrap.cc:654] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.349622  5267 raft_consensus.cc:493] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.350244  5267 raft_consensus.cc:515] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.352437  5263 tablet_bootstrap.cc:492] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:47.352994  5263 ts_tablet_manager.cc:1403] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.010s
I20260709 12:25:47.355870  5263 raft_consensus.cc:359] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.356631  5263 raft_consensus.cc:385] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.356956  5263 raft_consensus.cc:740] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.357481  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c6522d7db94a48b906c63f7c31b8e6" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:47.357547  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c6522d7db94a48b906c63f7c31b8e6" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:47.357667  5263 consensus_queue.cc:260] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.358809  5148 raft_consensus.cc:2468] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:47.360054  5263 ts_tablet_manager.cc:1434] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
W20260709 12:25:47.359987  5039 leader_election.cc:343] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.360711  5267 leader_election.cc:290] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:47.361125  5263 tablet_bootstrap.cc:492] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:47.366707  5265 tablet_bootstrap.cc:492] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:47.367398  5263 tablet_bootstrap.cc:654] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.367434  5265 ts_tablet_manager.cc:1403] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.008s
I20260709 12:25:47.369508  5037 leader_election.cc:304] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:47.370990  5265 raft_consensus.cc:359] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.372017  5265 raft_consensus.cc:385] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.371508  5267 raft_consensus.cc:2804] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:47.372432  5265 raft_consensus.cc:740] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.373824  5265 consensus_queue.cc:260] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.374877  5267 raft_consensus.cc:493] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.375509  5267 raft_consensus.cc:3060] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.387081  5265 ts_tablet_manager.cc:1434] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:25:47.392882  5265 tablet_bootstrap.cc:492] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:47.405042  5262 tablet_bootstrap.cc:492] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:47.405589  5262 ts_tablet_manager.cc:1403] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.076s	user 0.028s	sys 0.037s
I20260709 12:25:47.408542  5262 raft_consensus.cc:359] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.409300  5262 raft_consensus.cc:385] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.409606  5262 raft_consensus.cc:740] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.410454  5262 consensus_queue.cc:260] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.413247  5265 tablet_bootstrap.cc:654] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.413084  5267 raft_consensus.cc:515] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.415990  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c6522d7db94a48b906c63f7c31b8e6" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:47.416679  5148 raft_consensus.cc:3060] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.420197  5262 ts_tablet_manager.cc:1434] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:25:47.421247  5262 tablet_bootstrap.cc:492] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:47.423837  5148 raft_consensus.cc:2468] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:47.425236  5037 leader_election.cc:304] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:47.426244  5285 raft_consensus.cc:2804] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:47.426761  5265 tablet_bootstrap.cc:492] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:47.427517  5265 ts_tablet_manager.cc:1403] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.007s
I20260709 12:25:47.432669  5267 leader_election.cc:290] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:47.434022  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c6522d7db94a48b906c63f7c31b8e6" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:47.434926  5265 raft_consensus.cc:359] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.437502  5265 raft_consensus.cc:385] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.437983  5265 raft_consensus.cc:740] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.438685  5262 tablet_bootstrap.cc:654] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.439503  5265 consensus_queue.cc:260] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.440405  5285 raft_consensus.cc:697] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:47.440588  5222 raft_consensus.cc:3060] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.441727  5263 tablet_bootstrap.cc:492] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:47.442162  5263 ts_tablet_manager.cc:1403] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.081s	user 0.022s	sys 0.057s
I20260709 12:25:47.443291  5285 consensus_queue.cc:237] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.444710  5262 tablet_bootstrap.cc:492] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:47.445161  5262 ts_tablet_manager.cc:1403] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 12:25:47.445158  5263 raft_consensus.cc:359] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.446159  5263 raft_consensus.cc:385] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.446460  5263 raft_consensus.cc:740] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.447295  5263 consensus_queue.cc:260] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.448285  5262 raft_consensus.cc:359] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.448995  5222 raft_consensus.cc:2468] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:47.449824  5263 ts_tablet_manager.cc:1434] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:47.449010  5262 raft_consensus.cc:385] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.452232  5262 raft_consensus.cc:740] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.453016  5262 consensus_queue.cc:260] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.454777  5265 ts_tablet_manager.cc:1434] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.006s
I20260709 12:25:47.455209  5262 ts_tablet_manager.cc:1434] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:25:47.456224  5262 tablet_bootstrap.cc:492] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:47.451826  5263 tablet_bootstrap.cc:492] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:47.463861  5265 tablet_bootstrap.cc:492] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:47.464285  5263 tablet_bootstrap.cc:654] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.473187  5265 tablet_bootstrap.cc:654] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.469153  5262 tablet_bootstrap.cc:654] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.477873  5263 tablet_bootstrap.cc:492] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:47.478369  5263 ts_tablet_manager.cc:1403] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.002s
I20260709 12:25:47.481207  5263 raft_consensus.cc:359] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.481931  5263 raft_consensus.cc:385] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.482239  5263 raft_consensus.cc:740] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.482954  5263 consensus_queue.cc:260] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.485176  5263 ts_tablet_manager.cc:1434] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:47.487351  5263 tablet_bootstrap.cc:492] T 1f1a988a2c4745a2baccff62720af502 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:47.488924  5262 tablet_bootstrap.cc:492] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:47.489449  5262 ts_tablet_manager.cc:1403] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.003s
I20260709 12:25:47.490309  5265 tablet_bootstrap.cc:492] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:47.490834  5265 ts_tablet_manager.cc:1403] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.005s
I20260709 12:25:47.492465  5262 raft_consensus.cc:359] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.493258  5262 raft_consensus.cc:385] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.493578  5262 raft_consensus.cc:740] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.493847  5263 tablet_bootstrap.cc:654] T 1f1a988a2c4745a2baccff62720af502 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.493748  5265 raft_consensus.cc:359] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.494513  5265 raft_consensus.cc:385] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.494963  5265 raft_consensus.cc:740] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.494560  5262 consensus_queue.cc:260] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.495826  5265 consensus_queue.cc:260] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.500385  5265 ts_tablet_manager.cc:1434] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:25:47.496310  4970 catalog_manager.cc:5697] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:47.501451  5265 tablet_bootstrap.cc:492] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:47.497614  5262 ts_tablet_manager.cc:1434] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:47.504027  5262 tablet_bootstrap.cc:492] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:47.508736  5265 tablet_bootstrap.cc:654] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.510215  5262 tablet_bootstrap.cc:654] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.511718  5263 tablet_bootstrap.cc:492] T 1f1a988a2c4745a2baccff62720af502 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:47.512315  5263 ts_tablet_manager.cc:1403] T 1f1a988a2c4745a2baccff62720af502 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.025s	user 0.004s	sys 0.013s
I20260709 12:25:47.515795  5263 raft_consensus.cc:359] T 1f1a988a2c4745a2baccff62720af502 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.516346  5285 raft_consensus.cc:493] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.517024  5285 raft_consensus.cc:515] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.522080  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea368926e6346baa3b0065d3c9c510e" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:47.523675  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea368926e6346baa3b0065d3c9c510e" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
W20260709 12:25:47.525804  5037 leader_election.cc:343] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.526484  5289 raft_consensus.cc:493] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:47.527315  5039 leader_election.cc:343] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.527127  5289 raft_consensus.cc:515] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.527928  5039 leader_election.cc:304] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:47.529160  5305 raft_consensus.cc:2749] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:47.529985  5289 leader_election.cc:290] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:47.530658  5263 raft_consensus.cc:385] T 1f1a988a2c4745a2baccff62720af502 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.531044  5263 raft_consensus.cc:740] T 1f1a988a2c4745a2baccff62720af502 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.532348  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1704f04d7be4e899c5cf5d05207f303" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:47.530093  5285 leader_election.cc:290] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:47.532950  5073 raft_consensus.cc:2468] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:47.533339  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1704f04d7be4e899c5cf5d05207f303" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:47.533929  5148 raft_consensus.cc:2468] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:47.533890  5289 raft_consensus.cc:493] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.534267  5187 leader_election.cc:304] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:47.535184  5288 raft_consensus.cc:2804] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:47.532027  5263 consensus_queue.cc:260] T 1f1a988a2c4745a2baccff62720af502 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.535549  5288 raft_consensus.cc:493] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.534870  5289 raft_consensus.cc:515] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.535902  5288 raft_consensus.cc:3060] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.537992  5289 leader_election.cc:290] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:47.539101  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1a988a2c4745a2baccff62720af502" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:47.539734  5148 raft_consensus.cc:2468] T 1f1a988a2c4745a2baccff62720af502 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:47.540905  5186 leader_election.cc:304] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:47.541698  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1a988a2c4745a2baccff62720af502" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
W20260709 12:25:47.543066  5187 leader_election.cc:343] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.546330  5262 tablet_bootstrap.cc:492] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:47.546787  5262 ts_tablet_manager.cc:1403] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.043s	user 0.027s	sys 0.011s
I20260709 12:25:47.546737  5288 raft_consensus.cc:515] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.547899  5263 ts_tablet_manager.cc:1434] T 1f1a988a2c4745a2baccff62720af502 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.001s
I20260709 12:25:47.548890  5263 tablet_bootstrap.cc:492] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:47.549605  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1704f04d7be4e899c5cf5d05207f303" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:47.549540  5262 raft_consensus.cc:359] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.550343  5073 raft_consensus.cc:3060] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.550453  5262 raft_consensus.cc:385] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.550832  5262 raft_consensus.cc:740] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.551641  5262 consensus_queue.cc:260] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.555289  5263 tablet_bootstrap.cc:654] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.556399  5262 ts_tablet_manager.cc:1434] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:25:47.541705  5289 raft_consensus.cc:2804] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:47.556978  5289 raft_consensus.cc:493] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.557340  5262 tablet_bootstrap.cc:492] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:47.559008  5073 raft_consensus.cc:2468] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:47.560683  5187 leader_election.cc:304] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:47.557336  5289 raft_consensus.cc:3060] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.561663  5287 raft_consensus.cc:2804] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:47.562228  5287 raft_consensus.cc:697] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:25:47.563177  5262 tablet_bootstrap.cc:654] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.563050  5287 consensus_queue.cc:237] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
W20260709 12:25:47.564436  5187 consensus_peers.cc:597] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:47.569716  5288 leader_election.cc:290] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:47.570325  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1704f04d7be4e899c5cf5d05207f303" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:47.570950  5148 raft_consensus.cc:3060] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.572751  5289 raft_consensus.cc:515] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.576704  5265 tablet_bootstrap.cc:492] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:47.577195  5265 ts_tablet_manager.cc:1403] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.022s
I20260709 12:25:47.579839  5265 raft_consensus.cc:359] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.576695  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1a988a2c4745a2baccff62720af502" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:47.581012  5148 raft_consensus.cc:2468] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:47.581244  5147 raft_consensus.cc:3060] T 1f1a988a2c4745a2baccff62720af502 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.583186  5263 tablet_bootstrap.cc:492] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:47.583644  5263 ts_tablet_manager.cc:1403] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.000s
I20260709 12:25:47.577013  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1a988a2c4745a2baccff62720af502" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
W20260709 12:25:47.586092  5187 leader_election.cc:343] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.586285  5263 raft_consensus.cc:359] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.586964  5263 raft_consensus.cc:385] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.587237  5263 raft_consensus.cc:740] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.588253  5263 consensus_queue.cc:260] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.580482  5265 raft_consensus.cc:385] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.589000  5265 raft_consensus.cc:740] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.589771  5265 consensus_queue.cc:260] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.591346  5147 raft_consensus.cc:2468] T 1f1a988a2c4745a2baccff62720af502 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:47.591820  5265 ts_tablet_manager.cc:1434] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:25:47.592784  5265 tablet_bootstrap.cc:492] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:47.592622  5186 leader_election.cc:304] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:25:47.593498  5288 raft_consensus.cc:2804] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:47.593950  5288 raft_consensus.cc:697] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:25:47.594749  5288 consensus_queue.cc:237] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.575239  5289 leader_election.cc:290] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:47.598376  5263 ts_tablet_manager.cc:1434] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:25:47.601220  5262 tablet_bootstrap.cc:492] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:47.601693  5262 ts_tablet_manager.cc:1403] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.019s
I20260709 12:25:47.604238  5262 raft_consensus.cc:359] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.604928  5262 raft_consensus.cc:385] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.605242  5262 raft_consensus.cc:740] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.606168  5262 consensus_queue.cc:260] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.606980  4969 catalog_manager.cc:5697] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:47.608107  5265 tablet_bootstrap.cc:654] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.611652  5262 ts_tablet_manager.cc:1434] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:25:47.613544  5263 tablet_bootstrap.cc:492] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:47.613586  5262 tablet_bootstrap.cc:492] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
W20260709 12:25:47.618095  5039 consensus_peers.cc:597] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Couldn't send request to peer 6e72ecbdf12a4160856b2a57422118a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:47.620070  5262 tablet_bootstrap.cc:654] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.625025  5263 tablet_bootstrap.cc:654] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.628201  5305 raft_consensus.cc:493] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.628744  5305 raft_consensus.cc:515] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.632663  4971 catalog_manager.cc:5697] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:47.631043  5305 leader_election.cc:290] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:47.634872  5305 consensus_queue.cc:1048] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:47.640375  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c872a85641bb42caaf228b2eeeafcc93" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:47.641021  5147 raft_consensus.cc:2468] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:47.642233  5285 raft_consensus.cc:493] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.642730  5285 raft_consensus.cc:515] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.645237  5037 leader_election.cc:304] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:47.647399  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500a5a8d445949f0b0d635fd3820f5c9" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:47.647843  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c872a85641bb42caaf228b2eeeafcc93" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:47.648029  5147 raft_consensus.cc:2468] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:47.648435  5222 raft_consensus.cc:2468] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:47.649241  5037 leader_election.cc:304] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:47.649981  5267 raft_consensus.cc:2804] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:47.650360  5267 raft_consensus.cc:493] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.650712  5267 raft_consensus.cc:3060] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.656906  5285 leader_election.cc:290] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:47.660547  5262 tablet_bootstrap.cc:492] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:47.661531  5262 ts_tablet_manager.cc:1403] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.019s
I20260709 12:25:47.661767  5263 tablet_bootstrap.cc:492] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:47.662195  5263 ts_tablet_manager.cc:1403] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.049s	user 0.023s	sys 0.019s
I20260709 12:25:47.662740  5265 tablet_bootstrap.cc:492] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:47.663250  5265 ts_tablet_manager.cc:1403] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.071s	user 0.007s	sys 0.021s
I20260709 12:25:47.664088  5262 raft_consensus.cc:359] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.664779  5262 raft_consensus.cc:385] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.664535  5263 raft_consensus.cc:359] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.665048  5262 raft_consensus.cc:740] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.665199  5263 raft_consensus.cc:385] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.665472  5263 raft_consensus.cc:740] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.665742  5262 consensus_queue.cc:260] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.666079  5263 consensus_queue.cc:260] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.666522  5265 raft_consensus.cc:359] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.667356  5265 raft_consensus.cc:385] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.667448  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500a5a8d445949f0b0d635fd3820f5c9" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:47.667721  5265 raft_consensus.cc:740] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.668078  5222 raft_consensus.cc:2468] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:47.668260  5263 ts_tablet_manager.cc:1434] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:47.668510  5265 consensus_queue.cc:260] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.669261  5263 tablet_bootstrap.cc:492] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:47.666942  5288 raft_consensus.cc:493] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.670089  5288 raft_consensus.cc:515] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.672155  5288 leader_election.cc:290] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:47.672857  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3c3b60ecf04db989b454ae1f760212" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:47.673241  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3c3b60ecf04db989b454ae1f760212" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:47.673473  5073 raft_consensus.cc:2468] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:47.673804  5262 ts_tablet_manager.cc:1434] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:25:47.674714  5262 tablet_bootstrap.cc:492] T 1f1a988a2c4745a2baccff62720af502 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:47.674755  5187 leader_election.cc:304] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:47.675648  5288 raft_consensus.cc:2804] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:47.675990  5288 raft_consensus.cc:493] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.657436  5285 raft_consensus.cc:2804] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:47.680656  5285 raft_consensus.cc:493] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:47.676710  5186 leader_election.cc:343] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.678431  5265 ts_tablet_manager.cc:1434] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:25:47.687134  5265 tablet_bootstrap.cc:492] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:47.688457  5285 raft_consensus.cc:3060] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.692763  5265 tablet_bootstrap.cc:654] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.680728  5263 tablet_bootstrap.cc:654] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.676350  5288 raft_consensus.cc:3060] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.682087  5262 tablet_bootstrap.cc:654] T 1f1a988a2c4745a2baccff62720af502 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.696043  5267 raft_consensus.cc:515] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.707293  5288 raft_consensus.cc:515] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.709393  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c872a85641bb42caaf228b2eeeafcc93" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:47.712141  5222 raft_consensus.cc:3060] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.713246  5267 leader_election.cc:290] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:47.699859  5285 raft_consensus.cc:515] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.723627  5288 leader_election.cc:290] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:47.718396  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c872a85641bb42caaf228b2eeeafcc93" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:47.749922  5148 raft_consensus.cc:3060] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.725231  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3c3b60ecf04db989b454ae1f760212" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:47.750900  5073 raft_consensus.cc:3060] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.751907  5263 tablet_bootstrap.cc:492] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:47.752391  5263 ts_tablet_manager.cc:1403] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.018s
I20260709 12:25:47.728440  5287 consensus_queue.cc:1048] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:25:47.752826  5222 raft_consensus.cc:2468] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:47.756880  5039 leader_election.cc:304] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:47.727248  5146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3c3b60ecf04db989b454ae1f760212" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:47.757905  5305 raft_consensus.cc:2804] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:47.758607  5262 tablet_bootstrap.cc:492] T 1f1a988a2c4745a2baccff62720af502 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:47.760581  5262 ts_tablet_manager.cc:1403] T 1f1a988a2c4745a2baccff62720af502 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.003s
I20260709 12:25:47.760442  5305 raft_consensus.cc:697] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:47.759789  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500a5a8d445949f0b0d635fd3820f5c9" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:47.764330  5147 raft_consensus.cc:3060] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.765569  5148 raft_consensus.cc:2468] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:47.768064  5073 raft_consensus.cc:2468] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:47.768191  5263 raft_consensus.cc:359] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.768854  5263 raft_consensus.cc:385] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.769269  5187 leader_election.cc:304] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:47.770134  5287 raft_consensus.cc:2804] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:47.770594  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500a5a8d445949f0b0d635fd3820f5c9" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:47.770264  5305 consensus_queue.cc:237] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.771131  5222 raft_consensus.cc:3060] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.771354  5287 raft_consensus.cc:697] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:25:47.772364  5287 consensus_queue.cc:237] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.760114  5265 tablet_bootstrap.cc:492] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:47.759037  5285 leader_election.cc:290] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:47.763571  5262 raft_consensus.cc:359] T 1f1a988a2c4745a2baccff62720af502 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.776079  5265 ts_tablet_manager.cc:1403] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.050s
I20260709 12:25:47.776031  5262 raft_consensus.cc:385] T 1f1a988a2c4745a2baccff62720af502 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.776475  5262 raft_consensus.cc:740] T 1f1a988a2c4745a2baccff62720af502 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.776162  5263 raft_consensus.cc:740] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
W20260709 12:25:47.777508  5186 leader_election.cc:343] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.777571  5262 consensus_queue.cc:260] T 1f1a988a2c4745a2baccff62720af502 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.777786  5263 consensus_queue.cc:260] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.770264  5147 raft_consensus.cc:2468] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:47.779742  5262 ts_tablet_manager.cc:1434] T 1f1a988a2c4745a2baccff62720af502 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:25:47.779978  5263 ts_tablet_manager.cc:1434] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 12:25:47.780596  5262 tablet_bootstrap.cc:492] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:47.779830  5037 leader_election.cc:304] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:47.781080  5263 tablet_bootstrap.cc:492] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:47.781543  5285 raft_consensus.cc:2804] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:47.782166  5285 raft_consensus.cc:697] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:47.782981  5285 consensus_queue.cc:237] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.786087  5265 raft_consensus.cc:359] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.786881  5265 raft_consensus.cc:385] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.787158  5265 raft_consensus.cc:740] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.789048  5262 tablet_bootstrap.cc:654] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.788672  5265 consensus_queue.cc:260] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.791229  5265 ts_tablet_manager.cc:1434] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:25:47.792227  5265 tablet_bootstrap.cc:492] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:47.798765  5305 raft_consensus.cc:493] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.799270  5305 raft_consensus.cc:515] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.802126  5305 leader_election.cc:290] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:47.804627  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f60339b6c34e54bbf6e9b4a4c1e54e" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:47.804710  5222 raft_consensus.cc:2468] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:47.806115  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f60339b6c34e54bbf6e9b4a4c1e54e" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:47.809091  4971 catalog_manager.cc:5697] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:47.807431  5039 leader_election.cc:343] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:47.811473  5037 leader_election.cc:343] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.811919  5037 leader_election.cc:304] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:47.813831  4970 catalog_manager.cc:5697] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:47.818320  5285 raft_consensus.cc:2749] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:47.819094  5263 tablet_bootstrap.cc:654] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.829411  5285 raft_consensus.cc:493] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.829943  5285 raft_consensus.cc:515] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.832496  5285 leader_election.cc:290] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:47.834496  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56941204ae3e40bba5254fad3092ebeb" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
W20260709 12:25:47.836483  5039 leader_election.cc:343] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.836846  5145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56941204ae3e40bba5254fad3092ebeb" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:47.837811  5145 raft_consensus.cc:2468] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:47.838835  5037 leader_election.cc:304] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:47.839715  5262 tablet_bootstrap.cc:492] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:47.840070  5262 ts_tablet_manager.cc:1403] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.009s
I20260709 12:25:47.839922  5285 raft_consensus.cc:2804] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:47.840332  5285 raft_consensus.cc:493] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.840693  5285 raft_consensus.cc:3060] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.841121  4968 catalog_manager.cc:5697] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:47.842649  5262 raft_consensus.cc:359] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.843300  5262 raft_consensus.cc:385] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.843564  5262 raft_consensus.cc:740] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.844154  5265 tablet_bootstrap.cc:654] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.844340  5262 consensus_queue.cc:260] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.846668  5262 ts_tablet_manager.cc:1434] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:25:47.847699  5262 tablet_bootstrap.cc:492] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:47.848933  5285 raft_consensus.cc:515] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.851783  5145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56941204ae3e40bba5254fad3092ebeb" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:47.852371  5145 raft_consensus.cc:3060] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.855453  5262 tablet_bootstrap.cc:654] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.858942  5263 tablet_bootstrap.cc:492] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:47.859558  5263 ts_tablet_manager.cc:1403] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.007s
I20260709 12:25:47.859681  5145 raft_consensus.cc:2468] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:47.860953  5037 leader_election.cc:304] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:47.861817  5267 raft_consensus.cc:2804] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:47.862303  5267 raft_consensus.cc:697] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:47.863131  5267 consensus_queue.cc:237] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.864243  5263 raft_consensus.cc:359] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.864960  5263 raft_consensus.cc:385] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.865237  5263 raft_consensus.cc:740] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.866008  5265 tablet_bootstrap.cc:492] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:47.865881  5263 consensus_queue.cc:260] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.866531  5265 ts_tablet_manager.cc:1403] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.010s
I20260709 12:25:47.867290  5322 consensus_queue.cc:1048] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:47.868191  5263 ts_tablet_manager.cc:1434] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:25:47.869488  5265 raft_consensus.cc:359] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.870293  5265 raft_consensus.cc:385] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.870738  5265 raft_consensus.cc:740] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.871833  5265 consensus_queue.cc:260] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.875633  5265 ts_tablet_manager.cc:1434] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:25:47.876613  5265 tablet_bootstrap.cc:492] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:47.877087  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56941204ae3e40bba5254fad3092ebeb" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:47.877902  5262 tablet_bootstrap.cc:492] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:47.878369  5262 ts_tablet_manager.cc:1403] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.002s
W20260709 12:25:47.878450  5039 leader_election.cc:343] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.879446  5285 leader_election.cc:290] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:47.881199  5262 raft_consensus.cc:359] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.881969  5262 raft_consensus.cc:385] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.882287  5262 raft_consensus.cc:740] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.883205  5262 consensus_queue.cc:260] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.882880  4968 catalog_manager.cc:5697] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:47.885497  5262 ts_tablet_manager.cc:1434] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:25:47.886364  5262 tablet_bootstrap.cc:492] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:47.889497  5263 tablet_bootstrap.cc:492] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:47.897389  5262 tablet_bootstrap.cc:654] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.901183  5263 tablet_bootstrap.cc:654] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.901726  5322 consensus_queue.cc:1048] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:47.909332  5322 raft_consensus.cc:493] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.909919  5322 raft_consensus.cc:515] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.912451  5265 tablet_bootstrap.cc:654] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.913166  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00d99b54ae4fda8d58410ef0b5c3e3" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:47.914014  5147 raft_consensus.cc:2468] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:47.918323  5285 raft_consensus.cc:493] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.919251  5322 leader_election.cc:290] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:47.918967  5285 raft_consensus.cc:515] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.920639  5037 leader_election.cc:304] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:47.921017  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00d99b54ae4fda8d58410ef0b5c3e3" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:47.921480  5322 raft_consensus.cc:2804] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:47.924633  5222 raft_consensus.cc:2468] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:47.924736  5322 raft_consensus.cc:493] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.925380  5322 raft_consensus.cc:3060] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.928375  5285 leader_election.cc:290] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:47.929178  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ebaac790104c1b849ecbeadadc2ac6" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:47.930505  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ebaac790104c1b849ecbeadadc2ac6" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:47.932335  5039 leader_election.cc:304] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:47.936295  5285 raft_consensus.cc:2749] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:47.947471  5322 raft_consensus.cc:515] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.950645  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00d99b54ae4fda8d58410ef0b5c3e3" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:47.950929  5322 leader_election.cc:290] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:47.951249  5147 raft_consensus.cc:3060] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.954356  5263 tablet_bootstrap.cc:492] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:47.955379  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00d99b54ae4fda8d58410ef0b5c3e3" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:47.955752  5263 ts_tablet_manager.cc:1403] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.018s
I20260709 12:25:47.956072  5222 raft_consensus.cc:3060] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.958586  5265 tablet_bootstrap.cc:492] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:47.959069  5265 ts_tablet_manager.cc:1403] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.001s
I20260709 12:25:47.960091  5262 tablet_bootstrap.cc:492] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:47.960529  5262 ts_tablet_manager.cc:1403] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.074s	user 0.022s	sys 0.036s
I20260709 12:25:47.958398  5147 raft_consensus.cc:2468] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:47.961824  5265 raft_consensus.cc:359] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.962049  5269 raft_consensus.cc:493] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.962483  5265 raft_consensus.cc:385] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.962322  5037 leader_election.cc:304] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:47.962819  5265 raft_consensus.cc:740] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.962600  5269 raft_consensus.cc:515] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.963223  5322 raft_consensus.cc:2804] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:47.963683  5322 raft_consensus.cc:697] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:47.963614  5265 consensus_queue.cc:260] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.964766  5269 leader_election.cc:290] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:47.964658  5322 consensus_queue.cc:237] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.966356  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea368926e6346baa3b0065d3c9c510e" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:47.966979  5221 raft_consensus.cc:2468] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:47.968219  5114 leader_election.cc:304] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:47.968766  5222 raft_consensus.cc:2468] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:47.969058  5269 raft_consensus.cc:2804] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:47.972302  5269 raft_consensus.cc:493] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.972710  5269 raft_consensus.cc:3060] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.970438  5263 raft_consensus.cc:359] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.974668  5263 raft_consensus.cc:385] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.975034  5263 raft_consensus.cc:740] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.975970  5263 consensus_queue.cc:260] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.979955  5269 raft_consensus.cc:515] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.981190  5265 ts_tablet_manager.cc:1434] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 12:25:47.982000  5269 leader_election.cc:290] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:47.982285  5265 tablet_bootstrap.cc:492] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:47.969748  5262 raft_consensus.cc:359] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.969887  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea368926e6346baa3b0065d3c9c510e" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:47.982821  5262 raft_consensus.cc:385] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.982930  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea368926e6346baa3b0065d3c9c510e" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:47.983080  5073 raft_consensus.cc:2468] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:47.983145  5262 raft_consensus.cc:740] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.984019  5262 consensus_queue.cc:260] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.984059  4968 catalog_manager.cc:5697] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:47.986140  5262 ts_tablet_manager.cc:1434] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:25:47.986068  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea368926e6346baa3b0065d3c9c510e" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:47.986804  5222 raft_consensus.cc:3060] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.987074  5262 tablet_bootstrap.cc:492] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:47.988715  5285 raft_consensus.cc:493] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.989282  5285 raft_consensus.cc:515] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:47.991662  5285 leader_election.cc:290] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:47.994405  5262 tablet_bootstrap.cc:654] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.994302  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5afebfa702646d8b7372e8562e97d71" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
W20260709 12:25:47.995970  5039 leader_election.cc:343] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.999272  5265 tablet_bootstrap.cc:654] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.001101  5221 raft_consensus.cc:3060] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.004882  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5afebfa702646d8b7372e8562e97d71" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:48.008831  5147 raft_consensus.cc:2468] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:48.006922  5285 raft_consensus.cc:493] T 1f1a988a2c4745a2baccff62720af502 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.012663  5037 leader_election.cc:304] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:48.011658  5285 raft_consensus.cc:515] T 1f1a988a2c4745a2baccff62720af502 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.012974  5265 tablet_bootstrap.cc:492] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:48.013572  5265 ts_tablet_manager.cc:1403] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.006s
I20260709 12:25:48.014817  5322 raft_consensus.cc:2804] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:48.015246  5322 raft_consensus.cc:493] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.015875  5322 raft_consensus.cc:3060] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.019265  5265 raft_consensus.cc:359] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.019994  5265 raft_consensus.cc:385] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.020285  5265 raft_consensus.cc:740] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.020459  5262 tablet_bootstrap.cc:492] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:48.021071  5262 ts_tablet_manager.cc:1403] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.014s
I20260709 12:25:48.023063  5222 raft_consensus.cc:2468] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:48.023949  5262 raft_consensus.cc:359] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.024349  5114 leader_election.cc:304] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:25:48.026194  5269 raft_consensus.cc:2804] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:48.026691  5269 raft_consensus.cc:697] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:25:48.027511  5263 ts_tablet_manager.cc:1434] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.008s
I20260709 12:25:48.027580  5269 consensus_queue.cc:237] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.028777  5263 tablet_bootstrap.cc:492] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:48.024983  5262 raft_consensus.cc:385] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.029825  5262 raft_consensus.cc:740] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.030175  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1a988a2c4745a2baccff62720af502" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:48.032339  5147 raft_consensus.cc:2393] T 1f1a988a2c4745a2baccff62720af502 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in current term 1: Already voted for candidate 6e72ecbdf12a4160856b2a57422118a3 in this term.
I20260709 12:25:48.030642  5285 leader_election.cc:290] T 1f1a988a2c4745a2baccff62720af502 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:48.031559  5265 consensus_queue.cc:260] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.037374  5262 consensus_queue.cc:260] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.039587  5262 ts_tablet_manager.cc:1434] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.009s
I20260709 12:25:48.040619  5262 tablet_bootstrap.cc:492] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:48.040270  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1a988a2c4745a2baccff62720af502" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:48.043735  5039 leader_election.cc:304] T 1f1a988a2c4745a2baccff62720af502 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:48.048141  5285 raft_consensus.cc:3060] T 1f1a988a2c4745a2baccff62720af502 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.046437  5263 tablet_bootstrap.cc:654] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.049527  5265 ts_tablet_manager.cc:1434] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.004s
I20260709 12:25:48.047482  5262 tablet_bootstrap.cc:654] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.036827  5322 raft_consensus.cc:515] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.053531  5265 tablet_bootstrap.cc:492] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:48.055802  5322 leader_election.cc:290] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:48.055755  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5afebfa702646d8b7372e8562e97d71" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:48.058310  5147 raft_consensus.cc:3060] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.060077  5265 tablet_bootstrap.cc:654] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.061969  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5afebfa702646d8b7372e8562e97d71" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
W20260709 12:25:48.063498  5039 leader_election.cc:343] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.065671  5263 tablet_bootstrap.cc:492] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:48.066166  5263 ts_tablet_manager.cc:1403] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.011s
I20260709 12:25:48.070142  5263 raft_consensus.cc:359] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.070904  5263 raft_consensus.cc:385] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.071201  5263 raft_consensus.cc:740] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.071869  5263 consensus_queue.cc:260] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.074069  5263 ts_tablet_manager.cc:1434] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:48.078469  5263 tablet_bootstrap.cc:492] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:48.081549  5285 raft_consensus.cc:2749] T 1f1a988a2c4745a2baccff62720af502 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:48.081887  5287 consensus_queue.cc:1048] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:48.086927  5147 raft_consensus.cc:2468] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:48.087956  5263 tablet_bootstrap.cc:654] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.089736  5037 leader_election.cc:304] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:48.090765  5073 raft_consensus.cc:3060] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.100279  4968 catalog_manager.cc:5697] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 0 to 1, leader changed from <none> to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:48.101434  5285 raft_consensus.cc:2804] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:48.103804  5285 raft_consensus.cc:697] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:48.105674  5285 consensus_queue.cc:237] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.117955  5262 tablet_bootstrap.cc:492] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:48.118505  5262 ts_tablet_manager.cc:1403] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.006s
I20260709 12:25:48.123400  5263 tablet_bootstrap.cc:492] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:48.123783  5289 consensus_queue.cc:1048] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:48.123989  5263 ts_tablet_manager.cc:1403] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.000s
I20260709 12:25:48.130632  5269 raft_consensus.cc:493] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.132195  5269 raft_consensus.cc:515] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.137315  5269 leader_election.cc:290] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:48.137830  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b25036e425414d9ac336d8b3074769" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:48.138008  5262 raft_consensus.cc:359] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.138759  5262 raft_consensus.cc:385] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.138712  5072 raft_consensus.cc:2468] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:48.139212  5262 raft_consensus.cc:740] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.140092  5263 raft_consensus.cc:359] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.140744  5263 raft_consensus.cc:385] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.141026  5263 raft_consensus.cc:740] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.139925  5262 consensus_queue.cc:260] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.141960  5263 consensus_queue.cc:260] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.147246  5262 ts_tablet_manager.cc:1434] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:25:48.149498  5263 ts_tablet_manager.cc:1434] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:25:48.152006  5263 tablet_bootstrap.cc:492] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:48.153460  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b25036e425414d9ac336d8b3074769" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:48.154377  5221 raft_consensus.cc:2468] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:48.155640  5113 leader_election.cc:304] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:48.161873  5269 raft_consensus.cc:2804] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:48.162431  5269 raft_consensus.cc:493] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.162912  5269 raft_consensus.cc:3060] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.167455  5344 raft_consensus.cc:493] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.168015  5344 raft_consensus.cc:515] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.171257  5289 consensus_queue.cc:1048] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:48.173563  5344 leader_election.cc:290] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:48.174139  5344 raft_consensus.cc:493] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.174582  5344 raft_consensus.cc:515] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.174962  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd4cf6677164933b892bc384682a045" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
W20260709 12:25:48.176905  5114 leader_election.cc:343] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.178790  5071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02feac6bfeab4925b7a3a954250788e4" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:48.181929  5262 tablet_bootstrap.cc:492] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:48.183655  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd4cf6677164933b892bc384682a045" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
W20260709 12:25:48.183851  5113 leader_election.cc:343] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.184449  5072 raft_consensus.cc:2468] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:48.188117  5322 consensus_queue.cc:1048] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:48.190727  5289 consensus_queue.cc:1048] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:48.193477  5113 leader_election.cc:304] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:48.191061  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02feac6bfeab4925b7a3a954250788e4" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
W20260709 12:25:48.195966  5114 leader_election.cc:343] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.196426  5114 leader_election.cc:304] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:48.192425  5265 tablet_bootstrap.cc:492] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:48.197712  5265 ts_tablet_manager.cc:1403] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.144s	user 0.044s	sys 0.072s
I20260709 12:25:48.207744  5269 raft_consensus.cc:515] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.189240  5344 leader_election.cc:290] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:48.214025  5289 raft_consensus.cc:493] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.214988  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b25036e425414d9ac336d8b3074769" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:48.220362  5072 raft_consensus.cc:3060] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.216361  5269 leader_election.cc:290] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:48.220108  5289 raft_consensus.cc:515] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.225275  5289 leader_election.cc:290] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:48.226505  5262 tablet_bootstrap.cc:654] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.222074  5360 raft_consensus.cc:2749] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:48.228466  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac38dc58d75468593dee0edaafb81c9" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:48.235632  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b25036e425414d9ac336d8b3074769" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:48.237666  5222 raft_consensus.cc:3060] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.233666  5285 consensus_queue.cc:1048] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:48.234174  5146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac38dc58d75468593dee0edaafb81c9" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:48.242040  5263 tablet_bootstrap.cc:654] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:48.238399  5187 leader_election.cc:343] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.243964  5072 raft_consensus.cc:2468] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
W20260709 12:25:48.246268  5018 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:25:48.255172  5186 leader_election.cc:343] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.255441  5113 leader_election.cc:304] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:48.256302  5344 raft_consensus.cc:2804] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:48.257047  5344 raft_consensus.cc:697] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:25:48.258167  5344 consensus_queue.cc:237] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.256196  5186 leader_election.cc:304] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:48.261025  5357 raft_consensus.cc:2804] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:48.261462  5289 raft_consensus.cc:2749] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:48.261579  5357 raft_consensus.cc:493] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.262118  5357 raft_consensus.cc:3060] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.265550  5265 raft_consensus.cc:359] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.266417  5265 raft_consensus.cc:385] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.266744  5265 raft_consensus.cc:740] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.267576  5265 consensus_queue.cc:260] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.281740  5285 consensus_queue.cc:1048] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:48.286891  5265 ts_tablet_manager.cc:1434] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.002s
I20260709 12:25:48.288308  5265 tablet_bootstrap.cc:492] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:48.296249  5222 raft_consensus.cc:2468] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:48.298457  5289 consensus_queue.cc:1048] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:48.302093  5285 consensus_queue.cc:1048] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:25:48.324759  5273 raft_consensus.cc:493] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.352238  5361 raft_consensus.cc:493] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.385221  5262 tablet_bootstrap.cc:492] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:48.331785  5273 raft_consensus.cc:515] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.386111  5262 ts_tablet_manager.cc:1403] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.204s	user 0.022s	sys 0.026s
I20260709 12:25:48.392228  5305 consensus_queue.cc:1048] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:48.387725  5361 raft_consensus.cc:515] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.394837  5273 leader_election.cc:290] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:48.396466  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffee9280ebbb43bf892976cab5021757" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:48.397588  5073 raft_consensus.cc:2468] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:48.400388  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3c3b60ecf04db989b454ae1f760212" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:48.401927  5265 tablet_bootstrap.cc:654] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.403355  5263 tablet_bootstrap.cc:492] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:48.403913  5263 ts_tablet_manager.cc:1403] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.252s	user 0.018s	sys 0.015s
I20260709 12:25:48.404695  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3c3b60ecf04db989b454ae1f760212" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:48.405465  5187 leader_election.cc:304] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:48.406332  5113 leader_election.cc:304] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:48.406909  5289 raft_consensus.cc:2804] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:48.407444  5289 raft_consensus.cc:493] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.407883  5289 raft_consensus.cc:3060] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.396891  5361 leader_election.cc:290] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:48.385679  5357 raft_consensus.cc:515] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.409839  4971 catalog_manager.cc:5697] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:48.407204  5344 raft_consensus.cc:2749] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:48.411810  5263 raft_consensus.cc:359] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.416638  5262 raft_consensus.cc:359] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.420233  5263 raft_consensus.cc:385] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.419358  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd4cf6677164933b892bc384682a045" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:48.420876  5072 raft_consensus.cc:3060] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.421438  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd4cf6677164933b892bc384682a045" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:48.421918  5262 raft_consensus.cc:385] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.421993  5222 raft_consensus.cc:3060] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.422466  5262 raft_consensus.cc:740] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.420565  5263 raft_consensus.cc:740] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.424968  5262 consensus_queue.cc:260] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.428622  5262 ts_tablet_manager.cc:1434] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 12:25:48.429435  5262 tablet_bootstrap.cc:492] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:48.429330  5263 consensus_queue.cc:260] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.439422  5263 ts_tablet_manager.cc:1434] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.006s
I20260709 12:25:48.440358  5263 tablet_bootstrap.cc:492] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
W20260709 12:25:48.440785  5039 consensus_peers.cc:597] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Couldn't send request to peer 6e72ecbdf12a4160856b2a57422118a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:48.442202  5072 raft_consensus.cc:2468] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:48.443755  5113 leader_election.cc:304] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:48.444734  5361 raft_consensus.cc:2804] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:48.445398  5361 raft_consensus.cc:697] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:25:48.446616  5222 raft_consensus.cc:2468] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:48.432668  5357 leader_election.cc:290] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:48.459033  5289 raft_consensus.cc:515] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.461833  5322 consensus_queue.cc:1048] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:48.462345  5289 leader_election.cc:290] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:48.462529  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffee9280ebbb43bf892976cab5021757" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:48.465992  5143 raft_consensus.cc:3060] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.467736  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffee9280ebbb43bf892976cab5021757" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:48.465626  5072 raft_consensus.cc:3060] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.478211  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffee9280ebbb43bf892976cab5021757" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:48.465896  5361 consensus_queue.cc:237] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.484388  5262 tablet_bootstrap.cc:654] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:48.487332  5186 leader_election.cc:343] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:48.489420  5186 leader_election.cc:343] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.490944  5289 consensus_queue.cc:1048] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:48.493577  5072 raft_consensus.cc:2468] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:48.501523  5265 tablet_bootstrap.cc:492] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:48.502262  5265 ts_tablet_manager.cc:1403] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.214s	user 0.012s	sys 0.006s
I20260709 12:25:48.505766  5263 tablet_bootstrap.cc:654] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.518230  5187 leader_election.cc:304] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:48.520741  5289 raft_consensus.cc:2804] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:48.521453  5289 raft_consensus.cc:697] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:25:48.522534  5289 consensus_queue.cc:237] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.525043  5357 consensus_queue.cc:1048] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:48.529918  5285 consensus_queue.cc:1048] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:48.533429  5265 raft_consensus.cc:359] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.534313  5265 raft_consensus.cc:385] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.534607  5265 raft_consensus.cc:740] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.535445  5265 consensus_queue.cc:260] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.535707  4968 catalog_manager.cc:5697] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 0 to 1, leader changed from <none> to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:48.538991  4968 catalog_manager.cc:5697] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 0 to 1, leader changed from <none> to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:48.539080  5039 consensus_peers.cc:597] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Couldn't send request to peer 6e72ecbdf12a4160856b2a57422118a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:48.550357  5265 ts_tablet_manager.cc:1434] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.001s
I20260709 12:25:48.559988  5265 tablet_bootstrap.cc:492] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:48.561650  5262 tablet_bootstrap.cc:492] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:48.562783  5262 ts_tablet_manager.cc:1403] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.133s	user 0.034s	sys 0.016s
I20260709 12:25:48.597601  5262 raft_consensus.cc:359] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.598244  5262 raft_consensus.cc:385] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.598698  5262 raft_consensus.cc:740] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.599488  5262 consensus_queue.cc:260] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.601836  5262 ts_tablet_manager.cc:1434] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:25:48.603462  5263 tablet_bootstrap.cc:492] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:48.603932  5263 ts_tablet_manager.cc:1403] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.164s	user 0.011s	sys 0.048s
I20260709 12:25:48.606236  5262 tablet_bootstrap.cc:492] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:48.612363  5263 raft_consensus.cc:359] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.613128  5263 raft_consensus.cc:385] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.613387  5263 raft_consensus.cc:740] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.614388  5263 consensus_queue.cc:260] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.619836  5263 ts_tablet_manager.cc:1434] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:25:48.621127  5263 tablet_bootstrap.cc:492] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:48.619120  5285 raft_consensus.cc:493] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.621819  5285 raft_consensus.cc:515] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.626026  5265 tablet_bootstrap.cc:654] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.626206  5072 raft_consensus.cc:3060] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.631256  5262 tablet_bootstrap.cc:654] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.631006  4968 catalog_manager.cc:5697] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:48.649823  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8da98a042af4ca9ac0ae86911498913" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
W20260709 12:25:48.653628  5039 leader_election.cc:343] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.658272  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8da98a042af4ca9ac0ae86911498913" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:48.663138  5267 consensus_queue.cc:1048] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:48.665931  5037 leader_election.cc:343] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.666390  5037 leader_election.cc:304] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:48.667222  5267 raft_consensus.cc:2749] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:48.657946  5285 leader_election.cc:290] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:48.670840  5263 tablet_bootstrap.cc:654] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.672168  5361 consensus_queue.cc:1048] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:48.684319  5262 tablet_bootstrap.cc:492] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:48.684846  5262 ts_tablet_manager.cc:1403] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.082s	user 0.019s	sys 0.001s
I20260709 12:25:48.685987  5265 tablet_bootstrap.cc:492] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:48.686425  5265 ts_tablet_manager.cc:1403] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.127s	user 0.026s	sys 0.015s
I20260709 12:25:48.687397  5262 raft_consensus.cc:359] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.688061  5262 raft_consensus.cc:385] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.688306  5262 raft_consensus.cc:740] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.688925  5265 raft_consensus.cc:359] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.689082  5262 consensus_queue.cc:260] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.689642  5265 raft_consensus.cc:385] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.689971  5265 raft_consensus.cc:740] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.690883  5262 ts_tablet_manager.cc:1434] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:48.691068  5265 consensus_queue.cc:260] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.691776  5262 tablet_bootstrap.cc:492] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:48.693001  5265 ts_tablet_manager.cc:1434] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:25:48.695984  5265 tablet_bootstrap.cc:492] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:48.699923  5263 tablet_bootstrap.cc:492] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:48.700524  5263 ts_tablet_manager.cc:1403] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.007s
I20260709 12:25:48.702395  5265 tablet_bootstrap.cc:654] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.706538  5262 tablet_bootstrap.cc:654] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.704071  5263 raft_consensus.cc:359] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.717629  5263 raft_consensus.cc:385] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.718000  5263 raft_consensus.cc:740] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.718677  5263 consensus_queue.cc:260] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.721221  5263 ts_tablet_manager.cc:1434] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 12:25:48.722196  5263 tablet_bootstrap.cc:492] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:48.722500  5361 consensus_queue.cc:1048] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:48.733178  5262 tablet_bootstrap.cc:492] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:48.737829  5262 ts_tablet_manager.cc:1403] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.000s
I20260709 12:25:48.736011  5265 tablet_bootstrap.cc:492] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:48.744220  5265 ts_tablet_manager.cc:1403] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.015s
I20260709 12:25:48.748431  5265 raft_consensus.cc:359] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.751286  5265 raft_consensus.cc:385] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.751691  5265 raft_consensus.cc:740] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.752588  5265 consensus_queue.cc:260] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.754715  5265 ts_tablet_manager.cc:1434] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:25:48.750496  5262 raft_consensus.cc:359] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.755646  5262 raft_consensus.cc:385] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.755927  5262 raft_consensus.cc:740] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.756805  5265 tablet_bootstrap.cc:492] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:48.756382  5262 consensus_queue.cc:260] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.756938  5362 consensus_queue.cc:1048] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:25:48.761085  5305 raft_consensus.cc:493] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.761561  5305 raft_consensus.cc:515] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.763047  5265 tablet_bootstrap.cc:654] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.763559  5305 leader_election.cc:290] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:48.765117  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eed62f347644556a405f7e6991cebf7" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
W20260709 12:25:48.767143  5037 leader_election.cc:343] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.768206  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eed62f347644556a405f7e6991cebf7" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
W20260709 12:25:48.769898  5039 leader_election.cc:343] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.770526  5039 leader_election.cc:304] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:48.771950  5322 raft_consensus.cc:2749] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:48.773823  5262 ts_tablet_manager.cc:1434] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:25:48.775597  5262 tablet_bootstrap.cc:492] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:48.776062  5263 tablet_bootstrap.cc:654] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.781689  5362 raft_consensus.cc:493] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.782248  5362 raft_consensus.cc:515] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.784144  5262 tablet_bootstrap.cc:654] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.784265  5265 tablet_bootstrap.cc:492] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:48.784567  5362 leader_election.cc:290] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:48.784723  5265 ts_tablet_manager.cc:1403] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.007s
I20260709 12:25:48.786818  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f60339b6c34e54bbf6e9b4a4c1e54e" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:48.787308  5265 raft_consensus.cc:359] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.787978  5265 raft_consensus.cc:385] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.788232  5265 raft_consensus.cc:740] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
W20260709 12:25:48.788216  5114 leader_election.cc:343] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.788359  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f60339b6c34e54bbf6e9b4a4c1e54e" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:48.789135  5072 raft_consensus.cc:2468] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:48.789407  5265 consensus_queue.cc:260] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.790578  5113 leader_election.cc:304] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:48.791826  5265 ts_tablet_manager.cc:1434] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:48.792905  5265 tablet_bootstrap.cc:492] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:48.796854  5262 tablet_bootstrap.cc:492] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:48.797245  5263 tablet_bootstrap.cc:492] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:48.797297  5262 ts_tablet_manager.cc:1403] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.003s
I20260709 12:25:48.797803  5263 ts_tablet_manager.cc:1403] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.003s
I20260709 12:25:48.798976  5265 tablet_bootstrap.cc:654] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.800143  5362 raft_consensus.cc:2804] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:48.799975  5262 raft_consensus.cc:359] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.800511  5362 raft_consensus.cc:493] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.800698  5262 raft_consensus.cc:385] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.800330  5263 raft_consensus.cc:359] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.800936  5362 raft_consensus.cc:3060] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.800963  5262 raft_consensus.cc:740] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.801106  5263 raft_consensus.cc:385] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.801527  5263 raft_consensus.cc:740] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.801759  5262 consensus_queue.cc:260] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.802269  5263 consensus_queue.cc:260] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.810999  5265 tablet_bootstrap.cc:492] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:48.811424  5265 ts_tablet_manager.cc:1403] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.006s
I20260709 12:25:48.813616  5263 ts_tablet_manager.cc:1434] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:25:48.813989  5262 ts_tablet_manager.cc:1434] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 12:25:48.813809  5265 raft_consensus.cc:359] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.814432  5265 raft_consensus.cc:385] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.814688  5265 raft_consensus.cc:740] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.814899  5262 tablet_bootstrap.cc:492] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:48.815508  5265 consensus_queue.cc:260] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.817786  5265 ts_tablet_manager.cc:1434] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:48.818629  5265 tablet_bootstrap.cc:492] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:48.821060  5262 tablet_bootstrap.cc:654] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.823961  5263 tablet_bootstrap.cc:492] T 22a881bcc72945ed82bb9c3b8125ada4 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:48.828398  5265 tablet_bootstrap.cc:654] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.832378  5262 tablet_bootstrap.cc:492] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:48.832875  5262 ts_tablet_manager.cc:1403] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:25:48.835182  5263 tablet_bootstrap.cc:654] T 22a881bcc72945ed82bb9c3b8125ada4 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.835597  5262 raft_consensus.cc:359] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.836292  5262 raft_consensus.cc:385] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.836596  5262 raft_consensus.cc:740] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.837368  5262 consensus_queue.cc:260] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.838271  5362 raft_consensus.cc:515] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.839495  5262 ts_tablet_manager.cc:1434] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:48.840454  5262 tablet_bootstrap.cc:492] T c83bfe7fc28a4548aa8923c761e8108d P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:48.847529  5262 tablet_bootstrap.cc:654] T c83bfe7fc28a4548aa8923c761e8108d P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.848213  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f60339b6c34e54bbf6e9b4a4c1e54e" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:48.848863  5072 raft_consensus.cc:3060] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.854241  5305 raft_consensus.cc:493] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.854761  5305 raft_consensus.cc:515] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.856949  5305 leader_election.cc:290] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:48.857527  5362 leader_election.cc:290] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:48.858325  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73298cac061840a88d6e43468fbb541d" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:48.858377  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73298cac061840a88d6e43468fbb541d" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:48.855860  5072 raft_consensus.cc:2468] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
W20260709 12:25:48.859367  5039 leader_election.cc:343] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.859705  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f60339b6c34e54bbf6e9b4a4c1e54e" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
W20260709 12:25:48.859853  5037 leader_election.cc:343] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.860280  5221 raft_consensus.cc:3060] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.860268  5037 leader_election.cc:304] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:48.860443  5113 leader_election.cc:304] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:48.861321  5362 raft_consensus.cc:2804] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:48.861413  5305 raft_consensus.cc:2749] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:48.861862  5362 raft_consensus.cc:697] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:25:48.862738  5362 consensus_queue.cc:237] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.865590  5221 raft_consensus.cc:2468] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:48.869848  5265 tablet_bootstrap.cc:492] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:48.870330  5262 tablet_bootstrap.cc:492] T c83bfe7fc28a4548aa8923c761e8108d P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:48.870371  5265 ts_tablet_manager.cc:1403] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.003s
I20260709 12:25:48.870589  5263 tablet_bootstrap.cc:492] T 22a881bcc72945ed82bb9c3b8125ada4 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:48.870936  5262 ts_tablet_manager.cc:1403] T c83bfe7fc28a4548aa8923c761e8108d P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 12:25:48.871424  5263 ts_tablet_manager.cc:1403] T 22a881bcc72945ed82bb9c3b8125ada4 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.009s
I20260709 12:25:48.873364  5262 raft_consensus.cc:359] T c83bfe7fc28a4548aa8923c761e8108d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.873301  5265 raft_consensus.cc:359] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.872774  4969 catalog_manager.cc:5697] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 0 to 1, leader changed from <none> to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:48.874056  5262 raft_consensus.cc:385] T c83bfe7fc28a4548aa8923c761e8108d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.874138  5265 raft_consensus.cc:385] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.874406  5262 raft_consensus.cc:740] T c83bfe7fc28a4548aa8923c761e8108d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.874547  5265 raft_consensus.cc:740] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.874540  5263 raft_consensus.cc:359] T 22a881bcc72945ed82bb9c3b8125ada4 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.875231  5305 raft_consensus.cc:493] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.875458  5263 raft_consensus.cc:385] T 22a881bcc72945ed82bb9c3b8125ada4 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.875136  5262 consensus_queue.cc:260] T c83bfe7fc28a4548aa8923c761e8108d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.875886  5263 raft_consensus.cc:740] T 22a881bcc72945ed82bb9c3b8125ada4 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.875615  5265 consensus_queue.cc:260] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.875751  5305 raft_consensus.cc:515] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.876812  5263 consensus_queue.cc:260] T 22a881bcc72945ed82bb9c3b8125ada4 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.877363  5262 ts_tablet_manager.cc:1434] T c83bfe7fc28a4548aa8923c761e8108d P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:48.878861  5263 ts_tablet_manager.cc:1434] T 22a881bcc72945ed82bb9c3b8125ada4 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:48.878971  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1640ee2f62349858037e353ecde48d8" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:48.879837  5263 tablet_bootstrap.cc:492] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
W20260709 12:25:48.880862  5037 leader_election.cc:343] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.880982  5344 consensus_queue.cc:1048] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:48.882211  5305 leader_election.cc:290] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:48.884903  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1640ee2f62349858037e353ecde48d8" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
W20260709 12:25:48.886432  5039 leader_election.cc:343] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.886888  5039 leader_election.cc:304] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:48.887445  5263 tablet_bootstrap.cc:654] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.889740  5265 ts_tablet_manager.cc:1434] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 12:25:48.890937  5265 tablet_bootstrap.cc:492] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:48.892975  5305 raft_consensus.cc:2749] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:48.889816  5262 tablet_bootstrap.cc:492] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:48.897935  5362 consensus_queue.cc:1048] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:48.906602  5262 tablet_bootstrap.cc:654] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.911234  5265 tablet_bootstrap.cc:654] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.926753  5288 raft_consensus.cc:493] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.927273  5288 raft_consensus.cc:515] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.929505  5288 leader_election.cc:290] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:48.931231  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5afebfa702646d8b7372e8562e97d71" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:48.935181  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5afebfa702646d8b7372e8562e97d71" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:48.935599  5265 tablet_bootstrap.cc:492] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:48.936206  5265 ts_tablet_manager.cc:1403] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.005s
I20260709 12:25:48.939836  5265 raft_consensus.cc:359] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.940719  5265 raft_consensus.cc:385] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.941007  5265 raft_consensus.cc:740] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.940903  5186 leader_election.cc:304] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:48.942054  5288 raft_consensus.cc:2749] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:48.947472  5288 raft_consensus.cc:493] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.947737  5265 consensus_queue.cc:260] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.948587  5288 raft_consensus.cc:515] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.950963  5265 ts_tablet_manager.cc:1434] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:25:48.951351  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a881bcc72945ed82bb9c3b8125ada4" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:48.951920  5072 raft_consensus.cc:2468] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:48.952338  5265 tablet_bootstrap.cc:492] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:48.953068  5187 leader_election.cc:304] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:48.953840  5289 raft_consensus.cc:2804] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:48.954186  5289 raft_consensus.cc:493] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.954278  5288 leader_election.cc:290] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:48.954540  5289 raft_consensus.cc:3060] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.955681  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a881bcc72945ed82bb9c3b8125ada4" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:48.956314  5144 raft_consensus.cc:2468] T 22a881bcc72945ed82bb9c3b8125ada4 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:48.961139  5289 raft_consensus.cc:515] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.963922  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a881bcc72945ed82bb9c3b8125ada4" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:48.964468  5072 raft_consensus.cc:3060] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.964829  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a881bcc72945ed82bb9c3b8125ada4" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:48.965548  5143 raft_consensus.cc:3060] T 22a881bcc72945ed82bb9c3b8125ada4 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.965875  5289 leader_election.cc:290] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:48.966396  5289 raft_consensus.cc:493] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.966813  5289 raft_consensus.cc:515] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.969030  5263 tablet_bootstrap.cc:492] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:48.969486  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4799f16941ac411c958d31adc8dbd44a" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:48.969864  5263 ts_tablet_manager.cc:1403] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.090s	user 0.020s	sys 0.014s
I20260709 12:25:48.971938  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4799f16941ac411c958d31adc8dbd44a" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:48.972405  5265 tablet_bootstrap.cc:654] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.972821  5288 raft_consensus.cc:493] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.972709  5148 raft_consensus.cc:2468] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:48.973407  5288 raft_consensus.cc:515] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.973739  5263 raft_consensus.cc:359] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.975322  5263 raft_consensus.cc:385] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:25:48.975675  5187 leader_election.cc:343] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.975996  5288 leader_election.cc:290] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:48.976256  5263 raft_consensus.cc:740] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.978003  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec76d9e7afeb4c04b652649a01ebdc52" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:48.977499  5263 consensus_queue.cc:260] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.978912  5072 raft_consensus.cc:2468] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:48.972839  5289 leader_election.cc:290] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:25:48.981564  5187 leader_election.cc:343] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.982234  5187 leader_election.cc:304] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:48.982975  5289 raft_consensus.cc:2804] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:48.982759  5186 leader_election.cc:304] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:25:48.983752  5263 ts_tablet_manager.cc:1434] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:25:48.984009  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec76d9e7afeb4c04b652649a01ebdc52" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:48.985208  5263 tablet_bootstrap.cc:492] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:48.985154  5289 raft_consensus.cc:697] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:25:48.986212  5273 raft_consensus.cc:2804] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:48.986099  5289 consensus_queue.cc:237] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:48.986764  5273 raft_consensus.cc:493] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.987294  5273 raft_consensus.cc:3060] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.992105  5263 tablet_bootstrap.cc:654] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:48.994870  5186 leader_election.cc:343] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:48.995638  5186 leader_election.cc:304] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:48.996495  5265 tablet_bootstrap.cc:492] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:48.999008  5265 ts_tablet_manager.cc:1403] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.004s
I20260709 12:25:48.999415  5288 raft_consensus.cc:2749] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:49.003798  5262 tablet_bootstrap.cc:492] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:49.004318  5262 ts_tablet_manager.cc:1403] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.115s	user 0.014s	sys 0.008s
I20260709 12:25:49.005174  5362 raft_consensus.cc:493] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.005431  5265 raft_consensus.cc:359] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.005656  5362 raft_consensus.cc:515] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.006274  5265 raft_consensus.cc:385] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.006608  5265 raft_consensus.cc:740] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.007064  5262 raft_consensus.cc:359] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.007727  5362 leader_election.cc:290] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:49.007803  5262 raft_consensus.cc:385] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.007366  5265 consensus_queue.cc:260] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.008225  5262 raft_consensus.cc:740] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.009509  5262 consensus_queue.cc:260] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.010605  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83bfe7fc28a4548aa8923c761e8108d" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:49.011255  5073 raft_consensus.cc:2468] T c83bfe7fc28a4548aa8923c761e8108d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:49.012305  5262 ts_tablet_manager.cc:1434] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:25:49.012639  5265 ts_tablet_manager.cc:1434] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.005s
I20260709 12:25:49.013622  5265 tablet_bootstrap.cc:492] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:49.017061  5262 tablet_bootstrap.cc:492] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:49.010605  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83bfe7fc28a4548aa8923c761e8108d" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:49.017731  5113 leader_election.cc:304] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:49.017970  5222 raft_consensus.cc:2468] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:49.019816  5362 raft_consensus.cc:2804] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:49.020994  5362 raft_consensus.cc:493] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.024850  5362 raft_consensus.cc:3060] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.026503  5273 raft_consensus.cc:515] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.024417  5143 raft_consensus.cc:2468] T 22a881bcc72945ed82bb9c3b8125ada4 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:49.029714  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4799f16941ac411c958d31adc8dbd44a" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:49.030339  5143 raft_consensus.cc:3060] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.031966  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4799f16941ac411c958d31adc8dbd44a" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:49.035687  5263 tablet_bootstrap.cc:492] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
W20260709 12:25:49.034690  5187 leader_election.cc:343] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:49.036324  5263 ts_tablet_manager.cc:1403] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.005s
I20260709 12:25:49.041559  5265 tablet_bootstrap.cc:654] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.041685  5263 raft_consensus.cc:359] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.042407  5263 raft_consensus.cc:385] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.035607  5273 leader_election.cc:290] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:49.042673  5263 raft_consensus.cc:740] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.043344  5263 consensus_queue.cc:260] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.044198  5262 tablet_bootstrap.cc:654] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.039144  4968 catalog_manager.cc:5697] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.049211  5143 raft_consensus.cc:2468] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:49.042763  5362 raft_consensus.cc:515] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.054365  5263 ts_tablet_manager.cc:1434] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:25:49.055318  5362 leader_election.cc:290] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:49.056891  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83bfe7fc28a4548aa8923c761e8108d" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:49.057485  5222 raft_consensus.cc:3060] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.057313  5186 leader_election.cc:304] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:25:49.058513  5273 raft_consensus.cc:2804] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:49.059505  5273 raft_consensus.cc:697] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:25:49.055316  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83bfe7fc28a4548aa8923c761e8108d" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:49.061239  5072 raft_consensus.cc:3060] T c83bfe7fc28a4548aa8923c761e8108d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.060333  5273 consensus_queue.cc:237] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.070870  5265 tablet_bootstrap.cc:492] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:49.071746  5265 ts_tablet_manager.cc:1403] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.012s
I20260709 12:25:49.074409  5262 tablet_bootstrap.cc:492] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:49.068476  5072 raft_consensus.cc:2468] T c83bfe7fc28a4548aa8923c761e8108d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:49.074944  5262 ts_tablet_manager.cc:1403] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.016s
I20260709 12:25:49.074868  5265 raft_consensus.cc:359] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.075933  5265 raft_consensus.cc:385] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.075771  5113 leader_election.cc:304] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:49.076397  5265 raft_consensus.cc:740] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.076789  5362 raft_consensus.cc:2804] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:49.077324  5362 raft_consensus.cc:697] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:25:49.077446  5265 consensus_queue.cc:260] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.078135  5362 consensus_queue.cc:237] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.080684  5265 ts_tablet_manager.cc:1434] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:49.078446  5262 raft_consensus.cc:359] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.081593  5262 raft_consensus.cc:385] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.081899  5262 raft_consensus.cc:740] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.082252  5265 tablet_bootstrap.cc:492] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:49.082614  5262 consensus_queue.cc:260] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.083170  5263 tablet_bootstrap.cc:492] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:49.088349  5262 ts_tablet_manager.cc:1434] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:25:49.089376  5262 tablet_bootstrap.cc:492] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:49.102197  5265 tablet_bootstrap.cc:654] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.102605  5322 raft_consensus.cc:493] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.102838  5262 tablet_bootstrap.cc:654] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.103258  5222 raft_consensus.cc:2468] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:49.103130  5322 raft_consensus.cc:515] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.106185  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6812f3677044ecba0f8e57690bef590" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:49.106482  5322 leader_election.cc:290] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:49.107713  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6812f3677044ecba0f8e57690bef590" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
W20260709 12:25:49.108994  5037 leader_election.cc:343] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:49.110639  5039 leader_election.cc:343] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:49.113273  5039 leader_election.cc:304] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:49.115077  5322 raft_consensus.cc:2749] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:49.120180  4968 catalog_manager.cc:5697] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.125473  5143 raft_consensus.cc:3060] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.126457  5265 tablet_bootstrap.cc:492] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:49.126977  5265 ts_tablet_manager.cc:1403] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.004s
I20260709 12:25:49.136044  5305 raft_consensus.cc:493] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.141762  5288 consensus_queue.cc:1048] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:49.148047  5263 tablet_bootstrap.cc:654] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.149396  5222 raft_consensus.cc:3060] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.163241  5265 raft_consensus.cc:359] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.164147  5265 raft_consensus.cc:385] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.164520  5265 raft_consensus.cc:740] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.165319  5265 consensus_queue.cc:260] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.167869  5265 ts_tablet_manager.cc:1434] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.041s	user 0.002s	sys 0.006s
I20260709 12:25:49.149889  5305 raft_consensus.cc:515] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.172676  5305 leader_election.cc:290] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:49.173807  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4799f16941ac411c958d31adc8dbd44a" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:49.180717  5148 raft_consensus.cc:2393] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in current term 1: Already voted for candidate 6e72ecbdf12a4160856b2a57422118a3 in this term.
I20260709 12:25:49.180629  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4799f16941ac411c958d31adc8dbd44a" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:49.182569  5039 leader_election.cc:304] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:49.183797  5305 raft_consensus.cc:3060] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.185345  5265 tablet_bootstrap.cc:492] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:49.193470  5262 tablet_bootstrap.cc:492] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:49.194195  5262 ts_tablet_manager.cc:1403] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.105s	user 0.010s	sys 0.006s
I20260709 12:25:49.197300  4970 catalog_manager.cc:5697] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 0 to 1, leader changed from <none> to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:49.206136  5305 raft_consensus.cc:2749] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:49.220363  5262 raft_consensus.cc:359] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.221330  5262 raft_consensus.cc:385] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.221698  5262 raft_consensus.cc:740] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.232692  5289 consensus_queue.cc:1048] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:49.290167  5263 tablet_bootstrap.cc:492] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:49.290764  5263 ts_tablet_manager.cc:1403] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.208s	user 0.016s	sys 0.002s
I20260709 12:25:49.294647  5263 raft_consensus.cc:359] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.295413  5263 raft_consensus.cc:385] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.295732  5263 raft_consensus.cc:740] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.296409  5263 consensus_queue.cc:260] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.298588  5263 ts_tablet_manager.cc:1434] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:49.298956  5265 tablet_bootstrap.cc:654] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.299600  5263 tablet_bootstrap.cc:492] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:49.299481  5344 consensus_queue.cc:1048] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:49.302336  5287 raft_consensus.cc:493] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.303040  5287 raft_consensus.cc:515] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.305758  5287 leader_election.cc:290] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:49.306595  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb629cfc440b4e6f8d2ab3ea5e5cba62" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:49.307343  5072 raft_consensus.cc:2468] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:49.309533  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb629cfc440b4e6f8d2ab3ea5e5cba62" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:49.311272  5187 leader_election.cc:304] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
W20260709 12:25:49.313757  5186 leader_election.cc:343] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:49.309559  5263 tablet_bootstrap.cc:654] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.314793  5287 raft_consensus.cc:2804] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:49.315241  5287 raft_consensus.cc:493] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.316053  5287 raft_consensus.cc:3060] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.309303  5262 consensus_queue.cc:260] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.319080  5262 ts_tablet_manager.cc:1434] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.124s	user 0.007s	sys 0.011s
I20260709 12:25:49.320060  5262 tablet_bootstrap.cc:492] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:49.327092  5344 consensus_queue.cc:1048] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:49.327891  5289 raft_consensus.cc:493] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.328418  5289 raft_consensus.cc:515] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.330538  5289 leader_election.cc:290] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:49.331202  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02feac6bfeab4925b7a3a954250788e4" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:49.331960  5072 raft_consensus.cc:2468] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:49.332190  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02feac6bfeab4925b7a3a954250788e4" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:49.332885  5143 raft_consensus.cc:2468] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:49.334218  5186 leader_election.cc:304] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:49.332998  5344 raft_consensus.cc:493] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.335120  5289 raft_consensus.cc:2804] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:49.337088  5289 raft_consensus.cc:493] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.337510  5289 raft_consensus.cc:3060] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.338014  5287 raft_consensus.cc:515] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.335103  5344 raft_consensus.cc:515] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.341148  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb629cfc440b4e6f8d2ab3ea5e5cba62" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:49.341806  5072 raft_consensus.cc:3060] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.348935  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d46b792a2145b79909220733d7a533" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:49.350050  5344 leader_election.cc:290] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
W20260709 12:25:49.351009  5114 leader_election.cc:343] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:49.348760  5289 raft_consensus.cc:515] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.353298  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d46b792a2145b79909220733d7a533" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:49.355788  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02feac6bfeab4925b7a3a954250788e4" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:49.356355  5070 raft_consensus.cc:3060] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.356973  5072 raft_consensus.cc:2468] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:49.358153  5187 leader_election.cc:304] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:49.358405  5287 leader_election.cc:290] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:49.358991  5273 raft_consensus.cc:2804] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:49.359545  5273 raft_consensus.cc:697] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:25:49.359665  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb629cfc440b4e6f8d2ab3ea5e5cba62" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:49.360482  5273 consensus_queue.cc:237] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
W20260709 12:25:49.361359  5186 leader_election.cc:343] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:49.362416  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02feac6bfeab4925b7a3a954250788e4" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:49.362993  5143 raft_consensus.cc:3060] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.368093  5070 raft_consensus.cc:2468] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:49.369414  5262 tablet_bootstrap.cc:654] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.369824  5187 leader_election.cc:304] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:49.370960  5288 raft_consensus.cc:2804] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:49.371474  5288 raft_consensus.cc:697] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
W20260709 12:25:49.371559  5113 leader_election.cc:343] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:49.372539  5113 leader_election.cc:304] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:49.372437  5288 consensus_queue.cc:237] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.373922  5263 tablet_bootstrap.cc:492] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:49.374416  5263 ts_tablet_manager.cc:1403] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.000s
I20260709 12:25:49.374482  5421 raft_consensus.cc:2749] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:49.378250  5265 tablet_bootstrap.cc:492] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:49.378723  5265 ts_tablet_manager.cc:1403] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.199s	user 0.012s	sys 0.007s
I20260709 12:25:49.381515  5265 raft_consensus.cc:359] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.382208  5265 raft_consensus.cc:385] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.382499  5265 raft_consensus.cc:740] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.371953  5143 raft_consensus.cc:2468] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:49.376426  5289 leader_election.cc:290] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:49.386341  5263 raft_consensus.cc:359] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.387094  5263 raft_consensus.cc:385] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.387398  5263 raft_consensus.cc:740] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.388266  5265 consensus_queue.cc:260] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.389219  5287 consensus_queue.cc:1048] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:49.390611  5265 ts_tablet_manager.cc:1434] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:25:49.391594  5265 tablet_bootstrap.cc:492] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:49.397349  5263 consensus_queue.cc:260] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.399752  5263 ts_tablet_manager.cc:1434] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.005s
I20260709 12:25:49.405730  5263 tablet_bootstrap.cc:492] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
W20260709 12:25:49.415534  5018 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:49.416745  4969 catalog_manager.cc:5697] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.419450  5265 tablet_bootstrap.cc:654] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.418926  4969 catalog_manager.cc:5697] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.422077  5263 tablet_bootstrap.cc:654] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.429472  5262 tablet_bootstrap.cc:492] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:49.429983  5262 ts_tablet_manager.cc:1403] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.110s	user 0.010s	sys 0.003s
I20260709 12:25:49.432623  5273 consensus_queue.cc:1048] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:49.432601  5262 raft_consensus.cc:359] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.433552  5262 raft_consensus.cc:385] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.433868  5262 raft_consensus.cc:740] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.434525  5262 consensus_queue.cc:260] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.437104  5262 ts_tablet_manager.cc:1434] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:49.443065  5265 tablet_bootstrap.cc:492] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:49.443531  5265 ts_tablet_manager.cc:1403] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.052s	user 0.002s	sys 0.011s
I20260709 12:25:49.444425  5262 tablet_bootstrap.cc:492] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:49.444589  5273 consensus_queue.cc:1048] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:49.449738  5265 raft_consensus.cc:359] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.450269  5265 raft_consensus.cc:385] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.450543  5265 raft_consensus.cc:740] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.451272  5265 consensus_queue.cc:260] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.453233  5265 ts_tablet_manager.cc:1434] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:25:49.453558  5219 raft_consensus.cc:3060] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.454042  5265 tablet_bootstrap.cc:492] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:49.456187  5421 raft_consensus.cc:493] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.456670  5421 raft_consensus.cc:515] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.459390  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73298cac061840a88d6e43468fbb541d" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:49.460021  5072 raft_consensus.cc:2468] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:49.461525  5113 leader_election.cc:304] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:49.462394  5357 raft_consensus.cc:2804] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:49.462764  5357 raft_consensus.cc:493] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.463083  5357 raft_consensus.cc:3060] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.470854  5262 tablet_bootstrap.cc:654] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.472970  5421 leader_election.cc:290] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:49.473201  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73298cac061840a88d6e43468fbb541d" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
W20260709 12:25:49.475102  5114 leader_election.cc:343] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:49.480779  5265 tablet_bootstrap.cc:654] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.487434  5262 tablet_bootstrap.cc:492] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:49.487881  5262 ts_tablet_manager.cc:1403] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.003s
I20260709 12:25:49.487974  5357 raft_consensus.cc:515] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.490406  5262 raft_consensus.cc:359] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.491029  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73298cac061840a88d6e43468fbb541d" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:49.491626  5070 raft_consensus.cc:3060] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.499812  5070 raft_consensus.cc:2468] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:49.491029  5262 raft_consensus.cc:385] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.501119  5262 raft_consensus.cc:740] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.504287  5265 tablet_bootstrap.cc:492] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:49.504899  5265 ts_tablet_manager.cc:1403] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.002s
I20260709 12:25:49.505175  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73298cac061840a88d6e43468fbb541d" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
W20260709 12:25:49.506599  5114 leader_election.cc:343] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:49.507257  5273 consensus_queue.cc:1048] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:49.508883  5262 consensus_queue.cc:260] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.509922  5357 leader_election.cc:290] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:49.511473  5262 ts_tablet_manager.cc:1434] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.004s
I20260709 12:25:49.512362  5262 tablet_bootstrap.cc:492] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:49.508359  5265 raft_consensus.cc:359] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.517320  5265 raft_consensus.cc:385] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.517620  5265 raft_consensus.cc:740] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.517438  5113 leader_election.cc:304] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:49.518337  5265 consensus_queue.cc:260] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.518887  5357 raft_consensus.cc:2804] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:49.520282  5265 ts_tablet_manager.cc:1434] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:25:49.520500  5262 tablet_bootstrap.cc:654] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.521229  5265 tablet_bootstrap.cc:492] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:49.521838  5357 raft_consensus.cc:697] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:25:49.528326  5265 tablet_bootstrap.cc:654] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.533572  5263 tablet_bootstrap.cc:492] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:49.534042  5263 ts_tablet_manager.cc:1403] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.129s	user 0.015s	sys 0.016s
I20260709 12:25:49.530985  5262 tablet_bootstrap.cc:492] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:49.531311  5424 raft_consensus.cc:493] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.535501  5289 raft_consensus.cc:493] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.535399  5424 raft_consensus.cc:515] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.536008  5289 raft_consensus.cc:515] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.536418  5357 consensus_queue.cc:237] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.537652  5424 leader_election.cc:290] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:49.537941  5289 leader_election.cc:290] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:49.539994  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eed62f347644556a405f7e6991cebf7" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:49.540616  5070 raft_consensus.cc:2468] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:49.541409  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8da98a042af4ca9ac0ae86911498913" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:49.542017  5073 raft_consensus.cc:2468] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:49.535444  5262 ts_tablet_manager.cc:1403] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.006s
I20260709 12:25:49.542905  5187 leader_election.cc:304] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:49.544004  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eed62f347644556a405f7e6991cebf7" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:49.544627  5143 raft_consensus.cc:2468] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:49.546897  5262 raft_consensus.cc:359] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.547652  5344 consensus_queue.cc:1048] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:49.556663  5187 leader_election.cc:304] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:49.556946  5262 raft_consensus.cc:385] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.557365  5262 raft_consensus.cc:740] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.557535  5424 raft_consensus.cc:2804] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:49.557950  5424 raft_consensus.cc:493] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.558310  5424 raft_consensus.cc:3060] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.558151  5262 consensus_queue.cc:260] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.560350  5262 ts_tablet_manager.cc:1434] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 12:25:49.549036  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8da98a042af4ca9ac0ae86911498913" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:49.561338  5262 tablet_bootstrap.cc:492] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:49.562362  5263 raft_consensus.cc:359] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.563020  5263 raft_consensus.cc:385] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.563282  5263 raft_consensus.cc:740] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.553035  5273 raft_consensus.cc:2804] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:49.556434  5265 tablet_bootstrap.cc:492] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:49.565354  5265 ts_tablet_manager.cc:1403] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.005s
I20260709 12:25:49.568390  5265 raft_consensus.cc:359] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.569200  5265 raft_consensus.cc:385] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.569926  5265 raft_consensus.cc:740] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.570665  5265 consensus_queue.cc:260] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.572749  5265 ts_tablet_manager.cc:1434] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:49.571496  4971 catalog_manager.cc:5697] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 0 to 1, leader changed from <none> to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:49.573736  5265 tablet_bootstrap.cc:492] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:49.566154  5273 raft_consensus.cc:493] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.565320  5263 consensus_queue.cc:260] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.576112  5273 raft_consensus.cc:3060] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:49.579238  5186 leader_election.cc:343] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:49.592363  5263 ts_tablet_manager.cc:1434] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.002s
I20260709 12:25:49.594492  5263 tablet_bootstrap.cc:492] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:49.599277  5265 tablet_bootstrap.cc:654] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.606519  5263 tablet_bootstrap.cc:654] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.607906  5262 tablet_bootstrap.cc:654] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.615684  5424 raft_consensus.cc:515] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.618464  5424 leader_election.cc:290] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:49.619474  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8da98a042af4ca9ac0ae86911498913" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:49.622861  5305 raft_consensus.cc:493] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.623008  5357 consensus_queue.cc:1048] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:49.623374  5305 raft_consensus.cc:515] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.622180  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8da98a042af4ca9ac0ae86911498913" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
W20260709 12:25:49.628357  5186 leader_election.cc:343] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:49.648665  5305 leader_election.cc:290] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:49.649673  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac38dc58d75468593dee0edaafb81c9" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:49.650388  5219 raft_consensus.cc:2468] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:49.629916  5072 raft_consensus.cc:3060] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.611598  5273 raft_consensus.cc:515] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.694917  5305 raft_consensus.cc:493] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.695441  5305 raft_consensus.cc:515] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.697088  5039 leader_election.cc:304] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:49.697438  5305 leader_election.cc:290] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:49.697911  5267 raft_consensus.cc:2804] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:49.698283  5267 raft_consensus.cc:493] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.698601  5267 raft_consensus.cc:3060] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.699222  5262 tablet_bootstrap.cc:492] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:49.699657  5262 ts_tablet_manager.cc:1403] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.139s	user 0.023s	sys 0.050s
I20260709 12:25:49.701411  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac38dc58d75468593dee0edaafb81c9" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:49.702214  5262 raft_consensus.cc:359] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.702888  5262 raft_consensus.cc:385] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.703147  5262 raft_consensus.cc:740] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.703742  5262 consensus_queue.cc:260] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.704305  5265 tablet_bootstrap.cc:492] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:49.704731  5265 ts_tablet_manager.cc:1403] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.131s	user 0.016s	sys 0.003s
W20260709 12:25:49.706187  5037 leader_election.cc:343] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:49.707540  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d46b792a2145b79909220733d7a533" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:49.708487  5262 ts_tablet_manager.cc:1434] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:25:49.708403  5144 raft_consensus.cc:2468] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:49.700294  5072 raft_consensus.cc:2468] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:49.709905  5037 leader_election.cc:304] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:49.714792  5322 raft_consensus.cc:2804] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:49.715164  5322 raft_consensus.cc:493] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.715531  5322 raft_consensus.cc:3060] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.715816  5265 raft_consensus.cc:359] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.717983  5265 raft_consensus.cc:385] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.718220  5265 raft_consensus.cc:740] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.721053  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eed62f347644556a405f7e6991cebf7" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:49.721675  5070 raft_consensus.cc:3060] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.721393  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d46b792a2145b79909220733d7a533" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:49.722237  5219 raft_consensus.cc:2468] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:49.724985  5421 raft_consensus.cc:493] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.729045  5273 leader_election.cc:290] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:49.732831  5187 leader_election.cc:304] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:49.734402  5273 raft_consensus.cc:2804] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:49.735070  5273 raft_consensus.cc:697] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:25:49.725507  5421 raft_consensus.cc:515] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.735180  5265 consensus_queue.cc:260] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.737609  5265 ts_tablet_manager.cc:1434] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.002s
I20260709 12:25:49.737427  5273 consensus_queue.cc:237] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.739465  5267 raft_consensus.cc:515] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.741284  5265 tablet_bootstrap.cc:492] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:49.742170  5421 leader_election.cc:290] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:49.748225  5262 tablet_bootstrap.cc:492] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:49.754724  5263 tablet_bootstrap.cc:492] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:49.755393  5263 ts_tablet_manager.cc:1403] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.162s	user 0.014s	sys 0.019s
I20260709 12:25:49.756745  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eed62f347644556a405f7e6991cebf7" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:49.761798  5144 raft_consensus.cc:3060] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.770639  5441 raft_consensus.cc:493] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.771018  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec76d9e7afeb4c04b652649a01ebdc52" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:49.771323  5441 raft_consensus.cc:515] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.757105  5421 raft_consensus.cc:493] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.772738  5072 raft_consensus.cc:2468] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:49.772886  5421 raft_consensus.cc:515] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.774995  5421 leader_election.cc:290] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:49.775588  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec76d9e7afeb4c04b652649a01ebdc52" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:49.776216  5219 raft_consensus.cc:2468] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:49.776106  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb629cfc440b4e6f8d2ab3ea5e5cba62" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:49.788290  5113 leader_election.cc:304] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:49.791204  5421 raft_consensus.cc:2804] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:49.793316  5322 raft_consensus.cc:515] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.793640  5267 leader_election.cc:290] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:49.794716  5421 raft_consensus.cc:493] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.797464  5421 raft_consensus.cc:3060] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.793696  5070 raft_consensus.cc:2468] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:49.797972  5144 raft_consensus.cc:2468] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:49.799153  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb629cfc440b4e6f8d2ab3ea5e5cba62" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:49.800624  5187 leader_election.cc:304] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:49.801273  5072 raft_consensus.cc:2393] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d22f4ab7b09f42258209170e7c9214cb in current term 1: Already voted for candidate 6e72ecbdf12a4160856b2a57422118a3 in this term.
I20260709 12:25:49.802507  5113 leader_election.cc:304] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:49.803294  5357 raft_consensus.cc:3060] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.799057  5441 leader_election.cc:290] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:49.803481  4969 catalog_manager.cc:5697] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.804747  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac38dc58d75468593dee0edaafb81c9" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:49.805075  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec76d9e7afeb4c04b652649a01ebdc52" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:49.811224  5273 raft_consensus.cc:2804] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:49.811766  5273 raft_consensus.cc:697] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:25:49.812618  5273 consensus_queue.cc:237] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.812767  5322 leader_election.cc:290] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:49.819554  5265 tablet_bootstrap.cc:654] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.833885  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac38dc58d75468593dee0edaafb81c9" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:49.834477  5222 raft_consensus.cc:3060] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.835486  5287 consensus_queue.cc:1048] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:49.832801  5263 raft_consensus.cc:359] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.840827  5424 raft_consensus.cc:493] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.837239  5263 raft_consensus.cc:385] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.841420  5424 raft_consensus.cc:515] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.844913  5262 tablet_bootstrap.cc:654] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.846591  5424 leader_election.cc:290] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:49.844337  5263 raft_consensus.cc:740] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.852070  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec76d9e7afeb4c04b652649a01ebdc52" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:49.852901  5221 raft_consensus.cc:2468] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:49.854261  5263 consensus_queue.cc:260] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.855221  5148 raft_consensus.cc:3060] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.855400  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10627fec43d464e94516d46e5afc694" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:49.856323  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d46b792a2145b79909220733d7a533" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
W20260709 12:25:49.856809  5187 leader_election.cc:343] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:49.859963  4971 catalog_manager.cc:5697] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.856887  5219 raft_consensus.cc:3060] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.865887  5039 leader_election.cc:304] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:49.872467  5263 ts_tablet_manager.cc:1434] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.117s	user 0.008s	sys 0.001s
I20260709 12:25:49.870168  5148 raft_consensus.cc:2468] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:49.870468  5421 raft_consensus.cc:515] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.878337  5142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d46b792a2145b79909220733d7a533" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:49.879073  5142 raft_consensus.cc:3060] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.875080  5263 tablet_bootstrap.cc:492] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:49.877038  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10627fec43d464e94516d46e5afc694" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:49.889087  5143 raft_consensus.cc:2393] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in current term 1: Already voted for candidate d22f4ab7b09f42258209170e7c9214cb in this term.
I20260709 12:25:49.881362  5305 raft_consensus.cc:2804] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:49.890126  5305 raft_consensus.cc:493] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.890472  5305 raft_consensus.cc:3060] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.890995  5037 leader_election.cc:304] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:49.892640  5441 raft_consensus.cc:2804] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:49.893070  5441 raft_consensus.cc:697] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
W20260709 12:25:49.895911  5186 leader_election.cc:343] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:49.884245  5222 raft_consensus.cc:2468] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:49.896358  5186 leader_election.cc:304] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:49.893841  5441 consensus_queue.cc:237] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.897259  5273 raft_consensus.cc:2749] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:49.900043  5262 tablet_bootstrap.cc:492] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:49.900489  5262 ts_tablet_manager.cc:1403] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.153s	user 0.015s	sys 0.005s
I20260709 12:25:49.902798  5421 leader_election.cc:290] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:49.904158  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec76d9e7afeb4c04b652649a01ebdc52" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:49.906279  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec76d9e7afeb4c04b652649a01ebdc52" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:49.907095  5220 raft_consensus.cc:3060] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:49.908628  5265 tablet_bootstrap.cc:492] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:49.909157  5265 ts_tablet_manager.cc:1403] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.168s	user 0.007s	sys 0.013s
I20260709 12:25:49.912250  5265 raft_consensus.cc:359] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.912986  5265 raft_consensus.cc:385] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.913285  5265 raft_consensus.cc:740] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.913961  5265 consensus_queue.cc:260] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.914860  5142 raft_consensus.cc:2468] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:49.917816  5037 leader_election.cc:304] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:49.918586  5441 raft_consensus.cc:2804] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:49.920821  5219 raft_consensus.cc:2468] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:49.922833  5305 raft_consensus.cc:515] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.925191  5441 raft_consensus.cc:697] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:49.926326  5070 raft_consensus.cc:2393] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d22f4ab7b09f42258209170e7c9214cb in current term 1: Already voted for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in this term.
I20260709 12:25:49.927721  5220 raft_consensus.cc:2468] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:49.932926  5265 ts_tablet_manager.cc:1434] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:25:49.933643  5114 leader_election.cc:304] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:49.933905  5265 tablet_bootstrap.cc:492] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:49.934521  5421 raft_consensus.cc:2804] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:49.935041  5421 raft_consensus.cc:697] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:25:49.935817  5421 consensus_queue.cc:237] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.938242  5262 raft_consensus.cc:359] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.938941  5262 raft_consensus.cc:385] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.939247  5262 raft_consensus.cc:740] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.939855  5262 consensus_queue.cc:260] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.938832  5287 consensus_queue.cc:1048] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:49.941082  5357 raft_consensus.cc:2749] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:49.942946  5262 ts_tablet_manager.cc:1434] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 12:25:49.948800  5441 consensus_queue.cc:237] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.951958  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec76d9e7afeb4c04b652649a01ebdc52" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:49.953991  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec76d9e7afeb4c04b652649a01ebdc52" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:49.954816  5263 tablet_bootstrap.cc:654] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.954788  5289 consensus_queue.cc:1048] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:49.955474  5305 leader_election.cc:290] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:49.954795  5219 raft_consensus.cc:2393] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in current term 1: Already voted for candidate d22f4ab7b09f42258209170e7c9214cb in this term.
I20260709 12:25:49.960510  5039 leader_election.cc:304] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:49.961683  5305 raft_consensus.cc:2749] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:49.963971  5265 tablet_bootstrap.cc:654] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:49.973299  5273 consensus_queue.cc:1048] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:49.979597  5263 tablet_bootstrap.cc:492] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:49.980171  5263 ts_tablet_manager.cc:1403] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.105s	user 0.009s	sys 0.001s
I20260709 12:25:49.982959  5263 raft_consensus.cc:359] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.983593  5263 raft_consensus.cc:385] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:49.983886  5263 raft_consensus.cc:740] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:49.983665  4969 catalog_manager.cc:5697] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 0 to 1, leader changed from <none> to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:49.984694  5263 consensus_queue.cc:260] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:49.987280  5263 ts_tablet_manager.cc:1434] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:49.991242  5262 tablet_bootstrap.cc:492] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:49.995853  4970 catalog_manager.cc:5697] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:49.997532  4970 catalog_manager.cc:5697] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:49.998610  5265 tablet_bootstrap.cc:492] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:50.001852  5265 ts_tablet_manager.cc:1403] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.068s	user 0.017s	sys 0.007s
I20260709 12:25:49.998971  5263 tablet_bootstrap.cc:492] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:50.006031  5262 tablet_bootstrap.cc:654] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.007860  5265 raft_consensus.cc:359] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.008602  5265 raft_consensus.cc:385] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.008885  5265 raft_consensus.cc:740] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.009595  5265 consensus_queue.cc:260] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.011693  5265 ts_tablet_manager.cc:1434] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:25:50.015419  5263 tablet_bootstrap.cc:654] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.018739  5265 tablet_bootstrap.cc:492] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
W20260709 12:25:50.024763  5114 consensus_peers.cc:597] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb -> Peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Couldn't send request to peer 6e72ecbdf12a4160856b2a57422118a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:50.027650  5265 tablet_bootstrap.cc:654] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.041908  5262 tablet_bootstrap.cc:492] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:50.042255  5262 ts_tablet_manager.cc:1403] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.051s	user 0.023s	sys 0.002s
I20260709 12:25:50.044207  5262 raft_consensus.cc:359] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.044927  5262 raft_consensus.cc:385] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.045207  5262 raft_consensus.cc:740] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.045919  5262 consensus_queue.cc:260] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.047819  5262 ts_tablet_manager.cc:1434] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:50.049219  5262 tablet_bootstrap.cc:492] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:50.054912  5262 tablet_bootstrap.cc:654] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.070179  5273 raft_consensus.cc:493] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.070766  5273 raft_consensus.cc:515] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.071734  5263 tablet_bootstrap.cc:492] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:50.073601  5263 ts_tablet_manager.cc:1403] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.020s
I20260709 12:25:50.073980  5262 tablet_bootstrap.cc:492] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:50.074172  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c62b8870a024d5692b8e8b85185dbd6" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:50.076200  5263 raft_consensus.cc:359] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
W20260709 12:25:50.076488  5187 leader_election.cc:343] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.076879  5273 leader_election.cc:290] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:50.074416  5262 ts_tablet_manager.cc:1403] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.006s
I20260709 12:25:50.077131  5263 raft_consensus.cc:385] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.077448  5263 raft_consensus.cc:740] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.077616  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c62b8870a024d5692b8e8b85185dbd6" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:50.078110  5263 consensus_queue.cc:260] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.080127  5263 ts_tablet_manager.cc:1434] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:50.079787  5262 raft_consensus.cc:359] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.080452  5262 raft_consensus.cc:385] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.080753  5262 raft_consensus.cc:740] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
W20260709 12:25:50.081453  5186 leader_election.cc:343] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.081375  5262 consensus_queue.cc:260] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.081907  5186 leader_election.cc:304] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:50.082574  5265 tablet_bootstrap.cc:492] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:50.083086  5265 ts_tablet_manager.cc:1403] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.016s
I20260709 12:25:50.083825  5262 ts_tablet_manager.cc:1434] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:50.084813  5262 tablet_bootstrap.cc:492] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:50.084717  5273 raft_consensus.cc:2749] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:50.085856  5265 raft_consensus.cc:359] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.086558  5265 raft_consensus.cc:385] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.086959  5265 raft_consensus.cc:740] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.087306  5263 tablet_bootstrap.cc:492] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:50.087787  5265 consensus_queue.cc:260] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.090210  5265 ts_tablet_manager.cc:1434] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:50.091095  5265 tablet_bootstrap.cc:492] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:50.093230  5263 tablet_bootstrap.cc:654] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.096704  5265 tablet_bootstrap.cc:654] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.097826  5262 tablet_bootstrap.cc:654] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.101969  5421 raft_consensus.cc:493] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.102519  5421 raft_consensus.cc:515] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.106067  5265 tablet_bootstrap.cc:492] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:50.106570  5265 ts_tablet_manager.cc:1403] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:25:50.109341  5265 raft_consensus.cc:359] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.110234  5265 raft_consensus.cc:385] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.110594  5265 raft_consensus.cc:740] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.111347  5265 consensus_queue.cc:260] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.112306  5263 tablet_bootstrap.cc:492] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:50.112995  5263 ts_tablet_manager.cc:1403] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 12:25:50.113855  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1640ee2f62349858037e353ecde48d8" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:50.114573  5072 raft_consensus.cc:2468] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:50.115087  5265 ts_tablet_manager.cc:1434] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:50.116020  5265 tablet_bootstrap.cc:492] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:50.115617  5263 raft_consensus.cc:359] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.115866  5113 leader_election.cc:304] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:50.116375  5263 raft_consensus.cc:385] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.116672  5263 raft_consensus.cc:740] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.116803  5357 raft_consensus.cc:2804] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:50.117167  5357 raft_consensus.cc:493] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.117498  5357 raft_consensus.cc:3060] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.117370  5263 consensus_queue.cc:260] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.119127  5263 ts_tablet_manager.cc:1434] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:50.119966  5263 tablet_bootstrap.cc:492] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:50.104825  5421 leader_election.cc:290] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:50.117311  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1640ee2f62349858037e353ecde48d8" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:50.121750  5220 raft_consensus.cc:2468] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:50.123507  5265 tablet_bootstrap.cc:654] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.125336  5357 raft_consensus.cc:515] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.126173  5263 tablet_bootstrap.cc:654] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.129875  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1640ee2f62349858037e353ecde48d8" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:50.130666  5072 raft_consensus.cc:3060] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.134552  5265 tablet_bootstrap.cc:492] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:50.135426  5265 ts_tablet_manager.cc:1403] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.006s
I20260709 12:25:50.138191  5265 raft_consensus.cc:359] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.138840  5265 raft_consensus.cc:385] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.139117  5265 raft_consensus.cc:740] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.139707  5265 consensus_queue.cc:260] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.143752  5441 raft_consensus.cc:493] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.144618  5263 tablet_bootstrap.cc:492] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:50.144222  5441 raft_consensus.cc:515] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.145064  5263 ts_tablet_manager.cc:1403] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.007s
I20260709 12:25:50.146966  5265 ts_tablet_manager.cc:1434] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 12:25:50.148232  5273 raft_consensus.cc:493] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.148789  5273 raft_consensus.cc:515] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.146915  5357 leader_election.cc:290] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:50.149861  5357 raft_consensus.cc:493] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.149320  5262 tablet_bootstrap.cc:492] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:50.150852  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1640ee2f62349858037e353ecde48d8" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:50.152318  5263 raft_consensus.cc:359] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.152766  5219 raft_consensus.cc:3060] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.153033  5263 raft_consensus.cc:385] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.150944  5273 leader_election.cc:290] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:50.153502  5263 raft_consensus.cc:740] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.154070  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3892e26d8f94adabf8bd2581fee782b" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:50.154178  5263 consensus_queue.cc:260] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.154722  5070 raft_consensus.cc:2468] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:50.155794  5263 ts_tablet_manager.cc:1434] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:25:50.156702  5187 leader_election.cc:304] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:50.157581  5263 tablet_bootstrap.cc:492] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:50.158164  5265 tablet_bootstrap.cc:492] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:50.157548  5273 raft_consensus.cc:2804] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:50.158555  5273 raft_consensus.cc:493] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.158902  5273 raft_consensus.cc:3060] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.159957  5219 raft_consensus.cc:2468] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:50.161458  5114 leader_election.cc:304] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:50.162431  5467 raft_consensus.cc:2804] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:50.162992  5467 raft_consensus.cc:697] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:25:50.164304  5263 tablet_bootstrap.cc:654] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.157986  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3892e26d8f94adabf8bd2581fee782b" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:50.163883  5467 consensus_queue.cc:237] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.164860  5144 raft_consensus.cc:2468] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:50.152837  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7292f06cb5514a80849fe386d1f5edd5" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:50.164516  5265 tablet_bootstrap.cc:654] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.150945  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7292f06cb5514a80849fe386d1f5edd5" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:50.166242  5147 raft_consensus.cc:2468] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:50.168509  5037 leader_election.cc:304] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:50.169338  5305 raft_consensus.cc:2804] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:50.169660  5305 raft_consensus.cc:493] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.169965  5305 raft_consensus.cc:3060] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.170616  5262 ts_tablet_manager.cc:1403] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.086s	user 0.019s	sys 0.005s
I20260709 12:25:50.173020  5424 raft_consensus.cc:493] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.173667  5262 raft_consensus.cc:359] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.173641  5424 raft_consensus.cc:515] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.174523  5262 raft_consensus.cc:385] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.174804  5262 raft_consensus.cc:740] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.175410  5262 consensus_queue.cc:260] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.152326  5357 raft_consensus.cc:515] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.177606  5267 raft_consensus.cc:493] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.178295  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6812f3677044ecba0f8e57690bef590" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:50.178947  5070 raft_consensus.cc:2468] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:50.178198  5267 raft_consensus.cc:515] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.181087  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8da98a042af4ca9ac0ae86911498913" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:50.181370  5267 leader_election.cc:290] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:50.181442  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8da98a042af4ca9ac0ae86911498913" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:50.182256  5070 raft_consensus.cc:2393] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d22f4ab7b09f42258209170e7c9214cb in current term 1: Already voted for candidate 6e72ecbdf12a4160856b2a57422118a3 in this term.
I20260709 12:25:50.151794  5072 raft_consensus.cc:2468] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:50.182560  5187 leader_election.cc:304] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:50.183141  5357 leader_election.cc:290] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:50.183386  5287 raft_consensus.cc:2804] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:50.183763  5287 raft_consensus.cc:493] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.184078  5287 raft_consensus.cc:3060] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.184206  5113 leader_election.cc:304] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:50.186174  5357 consensus_queue.cc:1048] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:50.188375  5262 ts_tablet_manager.cc:1434] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:25:50.189395  5262 tablet_bootstrap.cc:492] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:50.189616  5441 leader_election.cc:290] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
W20260709 12:25:50.194370  5039 leader_election.cc:343] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.195783  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada8dc88d254884a47e7eb4f7f18244" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:50.196676  5222 raft_consensus.cc:2468] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:50.200147  5039 leader_election.cc:304] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:50.206314  5441 raft_consensus.cc:2804] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:50.176463  5424 leader_election.cc:290] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:50.208668  5441 raft_consensus.cc:493] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.209086  5441 raft_consensus.cc:3060] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.202605  5421 raft_consensus.cc:3060] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.218027  5262 tablet_bootstrap.cc:654] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.229576  5262 tablet_bootstrap.cc:492] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:50.230288  5262 ts_tablet_manager.cc:1403] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.000s
I20260709 12:25:50.229803  5287 raft_consensus.cc:515] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.234234  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6812f3677044ecba0f8e57690bef590" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:50.235049  5072 raft_consensus.cc:3060] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.239758  5424 consensus_queue.cc:1048] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:50.207688  5305 raft_consensus.cc:515] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.239919  5262 raft_consensus.cc:359] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.241786  5262 raft_consensus.cc:385] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.242076  5262 raft_consensus.cc:740] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.205025  5273 raft_consensus.cc:515] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.242230  5305 leader_election.cc:290] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:50.244515  5071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3892e26d8f94adabf8bd2581fee782b" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:50.245186  5071 raft_consensus.cc:3060] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.248836  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7292f06cb5514a80849fe386d1f5edd5" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:50.249132  5424 raft_consensus.cc:493] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.249739  5424 raft_consensus.cc:515] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.244464  5273 leader_election.cc:290] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:50.253340  5424 leader_election.cc:290] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:50.254179  5072 raft_consensus.cc:2468] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
W20260709 12:25:50.255071  5039 leader_election.cc:343] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.253580  5071 raft_consensus.cc:2468] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:50.255288  5187 leader_election.cc:304] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:50.256290  5187 leader_election.cc:304] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:50.257186  5287 leader_election.cc:290] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:50.257899  5287 raft_consensus.cc:2804] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:50.259207  5424 raft_consensus.cc:2804] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:50.259807  5287 raft_consensus.cc:697] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:25:50.254137  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc3c77d7a1a4a4c9cf2c6405234815d" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:50.260383  5262 consensus_queue.cc:260] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.260877  5287 consensus_queue.cc:237] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
W20260709 12:25:50.261483  5187 leader_election.cc:343] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.262712  5424 raft_consensus.cc:697] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:25:50.265718  5262 ts_tablet_manager.cc:1434] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:25:50.266786  5262 tablet_bootstrap.cc:492] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:50.267835  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6812f3677044ecba0f8e57690bef590" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:50.267751  5441 raft_consensus.cc:515] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.263600  5424 consensus_queue.cc:237] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.270334  5273 raft_consensus.cc:493] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.271735  5441 leader_election.cc:290] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:50.272300  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada8dc88d254884a47e7eb4f7f18244" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:50.272989  5219 raft_consensus.cc:3060] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.273391  5262 tablet_bootstrap.cc:654] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.283511  4969 catalog_manager.cc:5697] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 0 to 1, leader changed from <none> to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.289683  5421 raft_consensus.cc:2749] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:50.298394  5263 tablet_bootstrap.cc:492] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:50.298870  5263 ts_tablet_manager.cc:1403] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.141s	user 0.020s	sys 0.024s
I20260709 12:25:50.300911  5219 raft_consensus.cc:2468] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:50.301311  5263 raft_consensus.cc:359] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.317600  5288 consensus_queue.cc:1048] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:50.333496  5263 raft_consensus.cc:385] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.333825  5263 raft_consensus.cc:740] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.334563  5263 consensus_queue.cc:260] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.334419  4969 catalog_manager.cc:5697] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.335578  5145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7292f06cb5514a80849fe386d1f5edd5" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:50.305641  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada8dc88d254884a47e7eb4f7f18244" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:50.336162  5145 raft_consensus.cc:3060] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.302275  5039 leader_election.cc:304] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:50.338521  5305 raft_consensus.cc:2804] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:50.338984  5305 raft_consensus.cc:697] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:50.339787  5305 consensus_queue.cc:237] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.303504  5142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6812f3677044ecba0f8e57690bef590" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:50.303570  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc3c77d7a1a4a4c9cf2c6405234815d" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:50.333143  5265 tablet_bootstrap.cc:492] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:50.343806  5265 ts_tablet_manager.cc:1403] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.186s	user 0.015s	sys 0.023s
I20260709 12:25:50.302893  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3892e26d8f94adabf8bd2581fee782b" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:50.270982  5273 raft_consensus.cc:515] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.346487  5265 raft_consensus.cc:359] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.347170  5265 raft_consensus.cc:385] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.347426  5265 raft_consensus.cc:740] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.347597  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73298cac061840a88d6e43468fbb541d" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:50.344508  5147 raft_consensus.cc:3060] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.348995  5263 ts_tablet_manager.cc:1434] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 12:25:50.350063  5263 tablet_bootstrap.cc:492] T f6812f3677044ecba0f8e57690bef590 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
W20260709 12:25:50.350373  5039 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 48187.7us
I20260709 12:25:50.347541  5145 raft_consensus.cc:2468] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:50.359925  5263 tablet_bootstrap.cc:654] T f6812f3677044ecba0f8e57690bef590 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.348079  5265 consensus_queue.cc:260] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
W20260709 12:25:50.362538  5186 leader_election.cc:343] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.362943  5265 ts_tablet_manager.cc:1434] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.002s
I20260709 12:25:50.364131  5265 tablet_bootstrap.cc:492] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:50.365401  5288 consensus_queue.cc:1048] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:50.365797  5441 consensus_queue.cc:1048] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.369511  5145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada8dc88d254884a47e7eb4f7f18244" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:50.372179  5273 leader_election.cc:290] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:50.373418  5441 raft_consensus.cc:493] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.373486  5287 consensus_queue.cc:1048] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.373970  5441 raft_consensus.cc:515] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.375957  5441 leader_election.cc:290] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
W20260709 12:25:50.376592  5186 leader_election.cc:343] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:50.377310  5037 leader_election.cc:343] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:50.377719  5186 leader_election.cc:343] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.378111  5186 leader_election.cc:304] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:50.379730  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b732ffbeea492c9c4d91376c781263" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
W20260709 12:25:50.381203  5039 leader_election.cc:343] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.382580  5037 leader_election.cc:304] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:50.384195  5441 raft_consensus.cc:2804] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:50.385850  5441 raft_consensus.cc:697] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:50.387001  5441 consensus_queue.cc:237] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.391276  5145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73298cac061840a88d6e43468fbb541d" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:50.379756  5424 raft_consensus.cc:2749] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:50.393442  5305 raft_consensus.cc:493] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.393229  4968 catalog_manager.cc:5697] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.396517  5305 raft_consensus.cc:515] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
W20260709 12:25:50.396898  5037 leader_election.cc:343] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.398923  5305 leader_election.cc:290] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:50.411141  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10627fec43d464e94516d46e5afc694" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:50.411788  5220 raft_consensus.cc:2468] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:50.420771  5186 leader_election.cc:304] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:50.421764  5424 raft_consensus.cc:2749] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:50.422528  5305 raft_consensus.cc:493] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.422668  5039 leader_election.cc:304] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:50.423501  5267 raft_consensus.cc:2804] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:50.423862  5267 raft_consensus.cc:493] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.424228  5267 raft_consensus.cc:3060] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.428368  5262 tablet_bootstrap.cc:492] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:50.428917  5262 ts_tablet_manager.cc:1403] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.162s	user 0.028s	sys 0.032s
I20260709 12:25:50.428920  4969 catalog_manager.cc:5697] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.423014  5305 raft_consensus.cc:515] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.430907  4969 catalog_manager.cc:5697] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.435735  5265 tablet_bootstrap.cc:654] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.428948  5147 raft_consensus.cc:2468] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:50.438719  5421 consensus_queue.cc:1048] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.441391  5146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b732ffbeea492c9c4d91376c781263" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:50.442528  5142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10627fec43d464e94516d46e5afc694" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:50.449007  5305 leader_election.cc:290] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:50.440333  5262 raft_consensus.cc:359] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.453965  5262 raft_consensus.cc:385] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.454243  5262 raft_consensus.cc:740] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.455770  5262 consensus_queue.cc:260] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
W20260709 12:25:50.456386  5480 log.cc:927] Time spent T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:25:50.453264  5267 raft_consensus.cc:515] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.466756  5267 leader_election.cc:290] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:50.468279  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10627fec43d464e94516d46e5afc694" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:50.468384  5322 consensus_queue.cc:1048] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.468768  5263 tablet_bootstrap.cc:492] T f6812f3677044ecba0f8e57690bef590 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:50.468967  5222 raft_consensus.cc:3060] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.469267  5263 ts_tablet_manager.cc:1403] T f6812f3677044ecba0f8e57690bef590 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.119s	user 0.014s	sys 0.021s
I20260709 12:25:50.472023  5263 raft_consensus.cc:359] T f6812f3677044ecba0f8e57690bef590 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.472621  5263 raft_consensus.cc:385] T f6812f3677044ecba0f8e57690bef590 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.472911  5263 raft_consensus.cc:740] T f6812f3677044ecba0f8e57690bef590 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.473625  5263 consensus_queue.cc:260] T f6812f3677044ecba0f8e57690bef590 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.475065  5263 ts_tablet_manager.cc:1434] T f6812f3677044ecba0f8e57690bef590 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:50.475924  5263 tablet_bootstrap.cc:492] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:50.476500  5145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f424fe8428004213860887c1e4ed5796" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:50.481555  5263 tablet_bootstrap.cc:654] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:50.481753  5037 leader_election.cc:343] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.482055  5145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10627fec43d464e94516d46e5afc694" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:50.482234  5037 leader_election.cc:304] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:50.483930  5305 raft_consensus.cc:2749] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:50.484719  5305 consensus_queue.cc:1048] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:50.486778  5037 leader_election.cc:343] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.458067  5262 ts_tablet_manager.cc:1434] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:25:50.458612  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f424fe8428004213860887c1e4ed5796" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:50.458854  5273 raft_consensus.cc:493] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.488236  5273 raft_consensus.cc:515] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
W20260709 12:25:50.489735  5037 leader_election.cc:343] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.490276  5273 leader_election.cc:290] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:25:50.492228  5037 leader_election.cc:343] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.496974  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7292f06cb5514a80849fe386d1f5edd5" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:50.499364  5142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7292f06cb5514a80849fe386d1f5edd5" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:50.500098  5142 raft_consensus.cc:2393] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e72ecbdf12a4160856b2a57422118a3 in current term 1: Already voted for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in this term.
W20260709 12:25:50.497929  5018 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:50.502342  5186 leader_election.cc:304] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:50.502568  5471 consensus_queue.cc:1048] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:25:50.503350  5039 leader_election.cc:343] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.503841  5039 leader_election.cc:304] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:50.504662  5267 raft_consensus.cc:2749] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:50.505080  5287 raft_consensus.cc:3060] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.505820  5322 consensus_queue.cc:1048] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:50.516826  5287 raft_consensus.cc:2749] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:50.523984  5222 raft_consensus.cc:2468] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:50.528928  5039 leader_election.cc:304] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:50.529708  5267 raft_consensus.cc:2804] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:50.488265  5262 tablet_bootstrap.cc:492] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:50.530364  5267 raft_consensus.cc:697] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:50.531458  5267 consensus_queue.cc:237] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.539745  5263 tablet_bootstrap.cc:492] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:50.540266  5263 ts_tablet_manager.cc:1403] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.009s
I20260709 12:25:50.559444  5222 raft_consensus.cc:3060] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.573096  5265 tablet_bootstrap.cc:492] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:50.573573  5265 ts_tablet_manager.cc:1403] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.210s	user 0.012s	sys 0.010s
I20260709 12:25:50.576084  5265 raft_consensus.cc:359] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.576741  5265 raft_consensus.cc:385] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.576993  5265 raft_consensus.cc:740] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.577602  5265 consensus_queue.cc:260] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.578830  5263 raft_consensus.cc:359] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.579576  5263 raft_consensus.cc:385] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.581785  5263 raft_consensus.cc:740] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.582171  5262 tablet_bootstrap.cc:654] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.582438  5263 consensus_queue.cc:260] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.584970  5263 ts_tablet_manager.cc:1434] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.001s
I20260709 12:25:50.585850  5263 tablet_bootstrap.cc:492] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:50.589020  5265 ts_tablet_manager.cc:1434] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:25:50.590088  5265 tablet_bootstrap.cc:492] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:50.591766  5263 tablet_bootstrap.cc:654] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.606002  5265 tablet_bootstrap.cc:654] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.612387  5262 tablet_bootstrap.cc:492] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:50.612857  5262 ts_tablet_manager.cc:1403] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.125s	user 0.007s	sys 0.004s
I20260709 12:25:50.615463  5262 raft_consensus.cc:359] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.616138  5262 raft_consensus.cc:385] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.616847  5287 raft_consensus.cc:493] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.617304  5287 raft_consensus.cc:515] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.618031  5265 tablet_bootstrap.cc:492] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:50.618614  5265 ts_tablet_manager.cc:1403] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.006s
I20260709 12:25:50.620651  5287 leader_election.cc:290] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:50.621973  5145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b732ffbeea492c9c4d91376c781263" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:50.621984  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b732ffbeea492c9c4d91376c781263" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:50.616387  5262 raft_consensus.cc:740] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.622774  5070 raft_consensus.cc:2468] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:50.623373  5262 consensus_queue.cc:260] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.624008  5187 leader_election.cc:304] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
W20260709 12:25:50.624801  5186 leader_election.cc:343] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.625558  5262 ts_tablet_manager.cc:1434] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.004s
I20260709 12:25:50.625774  5287 raft_consensus.cc:2804] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:50.626216  5287 raft_consensus.cc:493] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.626546  5287 raft_consensus.cc:3060] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.626744  4971 catalog_manager.cc:5697] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.630544  5262 tablet_bootstrap.cc:492] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:50.637049  5262 tablet_bootstrap.cc:654] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.634856  5265 raft_consensus.cc:359] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.638686  5265 raft_consensus.cc:385] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.639035  5265 raft_consensus.cc:740] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.641664  5287 raft_consensus.cc:515] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.639766  5265 consensus_queue.cc:260] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.644773  5265 ts_tablet_manager.cc:1434] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:25:50.645045  5263 tablet_bootstrap.cc:492] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:50.645469  5263 ts_tablet_manager.cc:1403] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.023s
I20260709 12:25:50.645632  5265 tablet_bootstrap.cc:492] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:50.647986  5263 raft_consensus.cc:359] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.648661  5263 raft_consensus.cc:385] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.648955  5263 raft_consensus.cc:740] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.649713  5263 consensus_queue.cc:260] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.651690  5263 ts_tablet_manager.cc:1434] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:50.651914  5265 tablet_bootstrap.cc:654] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.652546  5263 tablet_bootstrap.cc:492] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:50.660249  5263 tablet_bootstrap.cc:654] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.660267  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b732ffbeea492c9c4d91376c781263" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:50.660979  5070 raft_consensus.cc:3060] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.670542  5070 raft_consensus.cc:2468] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:50.672133  5187 leader_election.cc:304] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:50.673370  5289 raft_consensus.cc:2804] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:50.673981  5289 raft_consensus.cc:697] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:25:50.675055  5289 consensus_queue.cc:237] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.677538  5267 raft_consensus.cc:493] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.678081  5267 raft_consensus.cc:515] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.680805  5273 consensus_queue.cc:1048] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.680822  5145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc3c77d7a1a4a4c9cf2c6405234815d" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:50.682360  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc3c77d7a1a4a4c9cf2c6405234815d" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:50.682771  5263 tablet_bootstrap.cc:492] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:50.682993  5262 tablet_bootstrap.cc:492] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:50.682889  5222 raft_consensus.cc:2468] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:50.683398  5263 ts_tablet_manager.cc:1403] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.008s
I20260709 12:25:50.683503  5262 ts_tablet_manager.cc:1403] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.015s
I20260709 12:25:50.684274  5039 leader_election.cc:304] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:50.685293  5441 raft_consensus.cc:2804] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:50.682775  5145 raft_consensus.cc:2468] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:50.686149  5262 raft_consensus.cc:359] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.687062  5262 raft_consensus.cc:385] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.685998  5263 raft_consensus.cc:359] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.687701  5263 raft_consensus.cc:385] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.687750  5267 leader_election.cc:290] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:50.688143  5263 raft_consensus.cc:740] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.685693  5441 raft_consensus.cc:493] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.688827  5441 raft_consensus.cc:3060] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.691385  5287 leader_election.cc:290] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:50.687407  5262 raft_consensus.cc:740] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.692617  5262 consensus_queue.cc:260] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.695128  5142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b732ffbeea492c9c4d91376c781263" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:50.695422  5262 ts_tablet_manager.cc:1434] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:25:50.696610  5262 tablet_bootstrap.cc:492] T b34eeef728364ce7a688984bb7fbbb91 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
W20260709 12:25:50.698022  5186 leader_election.cc:343] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.699625  5273 consensus_queue.cc:1048] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.700223  5263 consensus_queue.cc:260] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.703197  5263 ts_tablet_manager.cc:1434] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:25:50.704828  5263 tablet_bootstrap.cc:492] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:50.711324  5263 tablet_bootstrap.cc:654] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.712965  5441 raft_consensus.cc:515] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.714076  5471 consensus_queue.cc:1048] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.720597  5262 tablet_bootstrap.cc:654] T b34eeef728364ce7a688984bb7fbbb91 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.725108  5142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc3c77d7a1a4a4c9cf2c6405234815d" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:50.725730  5142 raft_consensus.cc:3060] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.725816  5344 consensus_queue.cc:1048] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.732875  5142 raft_consensus.cc:2468] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:50.732589  5263 tablet_bootstrap.cc:492] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:50.733984  5263 ts_tablet_manager.cc:1403] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.010s
I20260709 12:25:50.734177  5037 leader_election.cc:304] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:50.735128  5305 raft_consensus.cc:2804] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:50.735633  5305 raft_consensus.cc:697] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:50.736667  5305 consensus_queue.cc:237] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.746335  5344 raft_consensus.cc:493] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.746852  5344 raft_consensus.cc:515] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.749213  5344 leader_election.cc:290] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:50.751416  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34eeef728364ce7a688984bb7fbbb91" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:50.752301  5219 raft_consensus.cc:2468] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:50.753732  5441 leader_election.cc:290] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:50.755882  5114 leader_election.cc:304] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:50.756857  5344 raft_consensus.cc:2804] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:50.757190  5344 raft_consensus.cc:493] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.757498  5344 raft_consensus.cc:3060] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.757560  5263 raft_consensus.cc:359] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.758543  5263 raft_consensus.cc:385] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.758881  5263 raft_consensus.cc:740] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.759729  5263 consensus_queue.cc:260] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.761448  5071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34eeef728364ce7a688984bb7fbbb91" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:50.762008  5263 ts_tablet_manager.cc:1434] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:25:50.762861  5263 tablet_bootstrap.cc:492] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
W20260709 12:25:50.763490  5113 leader_election.cc:343] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:50.766726  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc3c77d7a1a4a4c9cf2c6405234815d" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:50.767297  5222 raft_consensus.cc:3060] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.770180  5263 tablet_bootstrap.cc:654] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.779351  5344 raft_consensus.cc:515] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.786782  5344 leader_election.cc:290] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:50.786901  5262 tablet_bootstrap.cc:492] T b34eeef728364ce7a688984bb7fbbb91 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:50.787444  5262 ts_tablet_manager.cc:1403] T b34eeef728364ce7a688984bb7fbbb91 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.007s
I20260709 12:25:50.784853  5222 raft_consensus.cc:2468] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:50.792538  5262 raft_consensus.cc:359] T b34eeef728364ce7a688984bb7fbbb91 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.793370  5262 raft_consensus.cc:385] T b34eeef728364ce7a688984bb7fbbb91 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.793674  5262 raft_consensus.cc:740] T b34eeef728364ce7a688984bb7fbbb91 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.790302  4970 catalog_manager.cc:5697] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.794250  5262 consensus_queue.cc:260] T b34eeef728364ce7a688984bb7fbbb91 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.794610  5263 tablet_bootstrap.cc:492] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:50.795104  5263 ts_tablet_manager.cc:1403] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.004s
I20260709 12:25:50.797822  5265 tablet_bootstrap.cc:492] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:50.798281  5265 ts_tablet_manager.cc:1403] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.153s	user 0.030s	sys 0.017s
I20260709 12:25:50.796936  5344 raft_consensus.cc:493] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.799826  5344 raft_consensus.cc:515] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.801366  5265 raft_consensus.cc:359] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.801993  5265 raft_consensus.cc:385] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.802253  5265 raft_consensus.cc:740] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.801738  4969 catalog_manager.cc:5697] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.799299  5421 raft_consensus.cc:493] T f6812f3677044ecba0f8e57690bef590 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.803460  5421 raft_consensus.cc:515] T f6812f3677044ecba0f8e57690bef590 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.805366  5421 leader_election.cc:290] T f6812f3677044ecba0f8e57690bef590 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:50.806612  5265 consensus_queue.cc:260] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.807727  5262 ts_tablet_manager.cc:1434] T b34eeef728364ce7a688984bb7fbbb91 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:25:50.808709  5262 tablet_bootstrap.cc:492] T ee33af6c31104d4abfff69a578ddc361 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:50.811887  5145 raft_consensus.cc:3060] T f6812f3677044ecba0f8e57690bef590 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.802230  5344 leader_election.cc:290] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:50.820762  5263 raft_consensus.cc:359] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.821700  5263 raft_consensus.cc:385] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.822023  5263 raft_consensus.cc:740] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.823721  5441 consensus_queue.cc:1048] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:50.829562  5263 consensus_queue.cc:260] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.832082  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34eeef728364ce7a688984bb7fbbb91" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:50.833009  5265 ts_tablet_manager.cc:1434] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:25:50.834115  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34eeef728364ce7a688984bb7fbbb91" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:50.834795  5070 raft_consensus.cc:3060] T b34eeef728364ce7a688984bb7fbbb91 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.837957  5265 tablet_bootstrap.cc:492] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:50.839547  5222 raft_consensus.cc:3060] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.854146  5263 ts_tablet_manager.cc:1434] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.002s
I20260709 12:25:50.844003  5421 raft_consensus.cc:493] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.863143  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10627fec43d464e94516d46e5afc694" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:50.857771  5344 raft_consensus.cc:493] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.866353  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10627fec43d464e94516d46e5afc694" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:50.867221  5221 raft_consensus.cc:2393] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d22f4ab7b09f42258209170e7c9214cb in current term 1: Already voted for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in this term.
I20260709 12:25:50.869282  5071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6812f3677044ecba0f8e57690bef590" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:50.870551  5070 raft_consensus.cc:2468] T b34eeef728364ce7a688984bb7fbbb91 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:50.872054  5441 consensus_queue.cc:1048] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.874547  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6812f3677044ecba0f8e57690bef590" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:50.874724  5287 consensus_queue.cc:1048] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.861361  5421 raft_consensus.cc:515] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.878120  5287 consensus_queue.cc:1048] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:50.878814  5421 leader_election.cc:290] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:50.882755  5114 leader_election.cc:304] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:50.889400  5265 tablet_bootstrap.cc:654] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.892395  5222 raft_consensus.cc:2468] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:50.890354  5511 raft_consensus.cc:3060] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.904072  5114 leader_election.cc:304] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:50.905277  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c62b8870a024d5692b8e8b85185dbd6" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:50.905771  5072 raft_consensus.cc:2468] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:50.909353  5421 raft_consensus.cc:2804] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:50.921033  5421 raft_consensus.cc:697] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:25:50.921036  5305 consensus_queue.cc:1048] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:50.922147  5421 consensus_queue.cc:237] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.881639  5344 raft_consensus.cc:515] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:50.927225  5263 tablet_bootstrap.cc:492] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:50.918496  5113 leader_election.cc:304] T f6812f3677044ecba0f8e57690bef590 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:50.956193  5262 tablet_bootstrap.cc:654] T ee33af6c31104d4abfff69a578ddc361 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.946105  5145 raft_consensus.cc:3060] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.927863  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c62b8870a024d5692b8e8b85185dbd6" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:51.010255  5467 raft_consensus.cc:2749] T f6812f3677044ecba0f8e57690bef590 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:51.032775  5344 leader_election.cc:290] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:51.024179  5219 raft_consensus.cc:2468] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:51.033879  5511 raft_consensus.cc:2749] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:51.019783  5113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 117625us
I20260709 12:25:51.041448  5265 tablet_bootstrap.cc:492] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:51.041895  5265 ts_tablet_manager.cc:1403] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.204s	user 0.013s	sys 0.007s
I20260709 12:25:51.047186  5113 leader_election.cc:304] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:51.048424  5467 raft_consensus.cc:2804] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:51.044639  5265 raft_consensus.cc:359] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.050812  5265 raft_consensus.cc:385] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.048797  5467 raft_consensus.cc:493] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.051965  5265 raft_consensus.cc:740] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.052723  5467 raft_consensus.cc:3060] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:51.061894  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee33af6c31104d4abfff69a578ddc361" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:51.069931  5263 tablet_bootstrap.cc:654] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.058117  5265 consensus_queue.cc:260] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
W20260709 12:25:51.074863  5113 leader_election.cc:343] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:51.070392  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee33af6c31104d4abfff69a578ddc361" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:51.071408  5511 raft_consensus.cc:493] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.112346  5441 consensus_queue.cc:1048] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:51.109318  5219 raft_consensus.cc:2468] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:51.115372  5511 raft_consensus.cc:515] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.068665  5467 raft_consensus.cc:515] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.119482  5265 ts_tablet_manager.cc:1434] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.001s
I20260709 12:25:51.122359  5265 tablet_bootstrap.cc:492] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:51.120877  5262 tablet_bootstrap.cc:492] T ee33af6c31104d4abfff69a578ddc361 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:51.123234  5262 ts_tablet_manager.cc:1403] T ee33af6c31104d4abfff69a578ddc361 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.315s	user 0.014s	sys 0.012s
I20260709 12:25:51.118685  5322 consensus_queue.cc:1048] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:25:51.119637  5114 leader_election.cc:304] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:25:51.128721  5421 raft_consensus.cc:2804] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:51.129073  5421 raft_consensus.cc:493] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.129405  5421 raft_consensus.cc:3060] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:51.133567  4969 catalog_manager.cc:5697] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 0 to 1, leader changed from <none> to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:51.145396  5421 raft_consensus.cc:515] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.197180  5071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada8dc88d254884a47e7eb4f7f18244" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:51.197261  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee33af6c31104d4abfff69a578ddc361" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:51.198244  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c62b8870a024d5692b8e8b85185dbd6" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:51.198818  5072 raft_consensus.cc:3060] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:51.200320  5113 leader_election.cc:343] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:51.206914  5072 raft_consensus.cc:2468] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:51.208205  5113 leader_election.cc:304] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:51.212394  5262 raft_consensus.cc:359] T ee33af6c31104d4abfff69a578ddc361 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.213686  5262 raft_consensus.cc:385] T ee33af6c31104d4abfff69a578ddc361 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.214004  5262 raft_consensus.cc:740] T ee33af6c31104d4abfff69a578ddc361 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.214524  5262 consensus_queue.cc:260] T ee33af6c31104d4abfff69a578ddc361 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.218361  5522 consensus_queue.cc:1048] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:25:51.213318  5344 raft_consensus.cc:2804] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:51.224404  5263 tablet_bootstrap.cc:492] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:51.225428  5263 ts_tablet_manager.cc:1403] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.323s	user 0.025s	sys 0.003s
I20260709 12:25:51.209391  5467 leader_election.cc:290] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:51.226890  5344 raft_consensus.cc:697] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:25:51.226895  5441 raft_consensus.cc:493] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.227507  5441 raft_consensus.cc:515] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.229854  5262 ts_tablet_manager.cc:1434] T ee33af6c31104d4abfff69a578ddc361 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.106s	user 0.010s	sys 0.004s
I20260709 12:25:51.230988  5262 tablet_bootstrap.cc:492] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:51.230861  5344 consensus_queue.cc:237] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.232329  5441 leader_election.cc:290] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:51.229790  5424 raft_consensus.cc:493] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.236099  5424 raft_consensus.cc:515] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.238296  5424 leader_election.cc:290] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:51.243238  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee33af6c31104d4abfff69a578ddc361" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:51.243737  5222 raft_consensus.cc:3060] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:51.244870  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c62b8870a024d5692b8e8b85185dbd6" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:51.245447  5218 raft_consensus.cc:3060] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:51.246765  5142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c924d344cb49639d42d3f21aa08cf2" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:51.247946  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada8dc88d254884a47e7eb4f7f18244" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:51.248320  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c924d344cb49639d42d3f21aa08cf2" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:51.249528  5114 leader_election.cc:304] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
W20260709 12:25:51.250384  5186 leader_election.cc:343] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:51.243557  5263 raft_consensus.cc:359] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.252214  5222 raft_consensus.cc:2468] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:51.253922  5263 raft_consensus.cc:385] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:25:51.253279  5187 leader_election.cc:343] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:51.254700  5187 leader_election.cc:304] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:51.255574  5273 raft_consensus.cc:2749] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:51.256776  5263 raft_consensus.cc:740] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.257586  5263 consensus_queue.cc:260] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.265609  5114 leader_election.cc:304] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:25:51.268209  5263 ts_tablet_manager.cc:1434] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.002s
I20260709 12:25:51.269673  5263 tablet_bootstrap.cc:492] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:51.271550  5512 raft_consensus.cc:2804] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:51.272275  5512 raft_consensus.cc:697] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:25:51.267467  5146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863b6a5fcc24d979cc005aaef6827ae" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:51.273334  5512 consensus_queue.cc:237] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.279459  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863b6a5fcc24d979cc005aaef6827ae" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:51.280242  5265 tablet_bootstrap.cc:654] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:51.283746  5039 leader_election.cc:343] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:51.280972  5467 raft_consensus.cc:2749] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:51.286375  5441 consensus_queue.cc:1048] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:51.289239  5511 leader_election.cc:290] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:51.295497  5441 consensus_queue.cc:1048] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:51.295616  5305 consensus_queue.cc:1048] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:25:51.298084  5037 leader_election.cc:343] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:51.298586  5037 leader_election.cc:304] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
W20260709 12:25:51.312325  5186 consensus_peers.cc:597] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:51.312741  5322 raft_consensus.cc:2749] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:51.329731  5263 tablet_bootstrap.cc:654] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.341135  5262 tablet_bootstrap.cc:654] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.357229  5218 raft_consensus.cc:2468] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:51.372287  5265 tablet_bootstrap.cc:492] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:51.372785  5265 ts_tablet_manager.cc:1403] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.251s	user 0.010s	sys 0.045s
I20260709 12:25:51.377182  5265 raft_consensus.cc:359] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.377724  5265 raft_consensus.cc:385] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.378010  5265 raft_consensus.cc:740] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.378862  5523 raft_consensus.cc:493] T ee33af6c31104d4abfff69a578ddc361 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.380209  5265 consensus_queue.cc:260] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.379436  5523 raft_consensus.cc:515] T ee33af6c31104d4abfff69a578ddc361 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.375662  5421 leader_election.cc:290] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:51.386102  5265 ts_tablet_manager.cc:1434] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:25:51.389400  5523 leader_election.cc:290] T ee33af6c31104d4abfff69a578ddc361 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:51.392295  5265 tablet_bootstrap.cc:492] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:51.400174  5263 tablet_bootstrap.cc:492] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:51.404485  5265 tablet_bootstrap.cc:654] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.404909  5263 ts_tablet_manager.cc:1403] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.136s	user 0.015s	sys 0.011s
I20260709 12:25:51.411972  4968 catalog_manager.cc:5697] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 0 to 1, leader changed from <none> to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:51.413965  4968 catalog_manager.cc:5697] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 0 to 1, leader changed from <none> to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:51.420322  5263 raft_consensus.cc:359] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.421034  5263 raft_consensus.cc:385] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.421595  5263 raft_consensus.cc:740] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.424036  5263 consensus_queue.cc:260] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.429350  5263 ts_tablet_manager.cc:1434] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:25:51.430362  5263 tablet_bootstrap.cc:492] T e5b732ffbeea492c9c4d91376c781263 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:51.430531  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee33af6c31104d4abfff69a578ddc361" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:51.431357  5221 raft_consensus.cc:2393] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in current term 1: Already voted for candidate d22f4ab7b09f42258209170e7c9214cb in this term.
I20260709 12:25:51.437666  5145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee33af6c31104d4abfff69a578ddc361" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:51.439363  5037 leader_election.cc:304] T ee33af6c31104d4abfff69a578ddc361 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:51.447355  5523 raft_consensus.cc:3060] T ee33af6c31104d4abfff69a578ddc361 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:51.447754  5262 tablet_bootstrap.cc:492] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:51.448271  5262 ts_tablet_manager.cc:1403] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.217s	user 0.013s	sys 0.008s
I20260709 12:25:51.448500  5263 tablet_bootstrap.cc:654] T e5b732ffbeea492c9c4d91376c781263 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.453090  5262 raft_consensus.cc:359] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.453857  5262 raft_consensus.cc:385] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.454146  5262 raft_consensus.cc:740] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.454488  5523 raft_consensus.cc:2749] T ee33af6c31104d4abfff69a578ddc361 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:51.454825  5262 consensus_queue.cc:260] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.456450  5262 ts_tablet_manager.cc:1434] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:25:51.457324  5265 tablet_bootstrap.cc:492] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:51.457608  5262 tablet_bootstrap.cc:492] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:51.457772  5265 ts_tablet_manager.cc:1403] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.004s
I20260709 12:25:51.463781  5262 tablet_bootstrap.cc:654] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.472177  5322 raft_consensus.cc:493] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.472936  5322 raft_consensus.cc:515] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.475876  5512 consensus_queue.cc:1048] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:51.477959  5145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c924d344cb49639d42d3f21aa08cf2" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:51.479705  5322 leader_election.cc:290] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
W20260709 12:25:51.480623  5037 leader_election.cc:343] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:51.484727  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c924d344cb49639d42d3f21aa08cf2" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:51.485617  5218 raft_consensus.cc:2468] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:51.486933  5265 raft_consensus.cc:359] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.487861  5265 raft_consensus.cc:385] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.488179  5265 raft_consensus.cc:740] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.489162  5039 leader_election.cc:304] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:51.489722  5262 tablet_bootstrap.cc:492] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:51.490206  5262 ts_tablet_manager.cc:1403] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.033s	user 0.003s	sys 0.010s
I20260709 12:25:51.490029  5322 raft_consensus.cc:2804] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:51.490643  5322 raft_consensus.cc:493] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.491307  5322 raft_consensus.cc:3060] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:51.491283  5265 consensus_queue.cc:260] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.494000  5265 ts_tablet_manager.cc:1434] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.003s
I20260709 12:25:51.494879  5265 tablet_bootstrap.cc:492] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:51.495018  5262 raft_consensus.cc:359] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.507046  5262 raft_consensus.cc:385] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.507366  5262 raft_consensus.cc:740] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.507958  5262 consensus_queue.cc:260] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.517553  5512 consensus_queue.cc:1048] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:51.522313  5262 ts_tablet_manager.cc:1434] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 12:25:51.523676  5262 tablet_bootstrap.cc:492] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:51.529356  5262 tablet_bootstrap.cc:654] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.540489  5265 tablet_bootstrap.cc:654] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.572283  5262 tablet_bootstrap.cc:492] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:51.572882  5262 ts_tablet_manager.cc:1403] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.049s	user 0.021s	sys 0.026s
I20260709 12:25:51.575935  5265 tablet_bootstrap.cc:492] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:51.575574  5262 raft_consensus.cc:359] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.576269  5262 raft_consensus.cc:385] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.576403  5265 ts_tablet_manager.cc:1403] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.005s
I20260709 12:25:51.576574  5262 raft_consensus.cc:740] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.577252  5262 consensus_queue.cc:260] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.578763  5262 ts_tablet_manager.cc:1434] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:51.578915  5265 raft_consensus.cc:359] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.579598  5262 tablet_bootstrap.cc:492] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:51.579550  5265 raft_consensus.cc:385] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.579978  5265 raft_consensus.cc:740] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.580722  5265 consensus_queue.cc:260] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.583024  5265 ts_tablet_manager.cc:1434] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:51.583910  5265 tablet_bootstrap.cc:492] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:51.586109  5262 tablet_bootstrap.cc:654] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.590436  5265 tablet_bootstrap.cc:654] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.593199  5322 raft_consensus.cc:515] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.597185  5262 tablet_bootstrap.cc:492] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:51.597985  5263 tablet_bootstrap.cc:492] T e5b732ffbeea492c9c4d91376c781263 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:51.601809  5262 ts_tablet_manager.cc:1403] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 12:25:51.601945  5263 ts_tablet_manager.cc:1403] T e5b732ffbeea492c9c4d91376c781263 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.172s	user 0.026s	sys 0.073s
I20260709 12:25:51.604527  5262 raft_consensus.cc:359] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.605202  5262 raft_consensus.cc:385] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.605446  5262 raft_consensus.cc:740] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.606645  5262 consensus_queue.cc:260] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.608692  5262 ts_tablet_manager.cc:1434] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:25:51.609544  5262 tablet_bootstrap.cc:492] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:51.612244  5265 tablet_bootstrap.cc:492] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:51.612788  5265 ts_tablet_manager.cc:1403] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.002s
I20260709 12:25:51.615703  5263 raft_consensus.cc:359] T e5b732ffbeea492c9c4d91376c781263 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.616406  5263 raft_consensus.cc:385] T e5b732ffbeea492c9c4d91376c781263 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.616690  5263 raft_consensus.cc:740] T e5b732ffbeea492c9c4d91376c781263 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.622507  5145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c924d344cb49639d42d3f21aa08cf2" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
W20260709 12:25:51.623939  5037 leader_election.cc:343] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:51.626313  5322 leader_election.cc:290] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:51.627339  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c924d344cb49639d42d3f21aa08cf2" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:51.627952  5218 raft_consensus.cc:3060] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:51.629607  5262 tablet_bootstrap.cc:654] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.632905  5263 consensus_queue.cc:260] T e5b732ffbeea492c9c4d91376c781263 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.631755  5265 raft_consensus.cc:359] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.635023  5263 ts_tablet_manager.cc:1434] T e5b732ffbeea492c9c4d91376c781263 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:25:51.635103  5265 raft_consensus.cc:385] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.635581  5265 raft_consensus.cc:740] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.635936  5263 tablet_bootstrap.cc:492] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:51.636325  5265 consensus_queue.cc:260] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.638662  5265 ts_tablet_manager.cc:1434] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 12:25:51.639878  5265 tablet_bootstrap.cc:492] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:51.647105  5265 tablet_bootstrap.cc:654] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.652740  5262 tablet_bootstrap.cc:492] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:51.647892  5322 raft_consensus.cc:493] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.656168  5322 raft_consensus.cc:515] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.662106  5262 ts_tablet_manager.cc:1403] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.005s
I20260709 12:25:51.664739  5262 raft_consensus.cc:359] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.665457  5262 raft_consensus.cc:385] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.665827  5263 tablet_bootstrap.cc:654] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.665797  5262 raft_consensus.cc:740] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.666560  5262 consensus_queue.cc:260] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.667193  5322 leader_election.cc:290] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:51.667930  5145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253cc4e85c5b4c18ac746b32b0a47e47" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:51.668058  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253cc4e85c5b4c18ac746b32b0a47e47" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:51.668742  5221 raft_consensus.cc:2468] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
W20260709 12:25:51.669550  5037 leader_election.cc:343] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:51.670262  5039 leader_election.cc:304] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:51.671074  5262 ts_tablet_manager.cc:1434] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:25:51.671774  5441 raft_consensus.cc:2804] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:51.672197  5441 raft_consensus.cc:493] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.672528  5441 raft_consensus.cc:3060] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:51.672978  5262 tablet_bootstrap.cc:492] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:51.694370  5421 raft_consensus.cc:493] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.695058  5218 raft_consensus.cc:2468] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:51.694875  5421 raft_consensus.cc:515] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.697257  5512 consensus_queue.cc:1048] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:51.697587  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f424fe8428004213860887c1e4ed5796" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:51.698155  5072 raft_consensus.cc:2468] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
W20260709 12:25:51.698554  5018 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:51.699024  5265 tablet_bootstrap.cc:492] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:51.699467  5265 ts_tablet_manager.cc:1403] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.060s	user 0.005s	sys 0.009s
I20260709 12:25:51.701602  5039 leader_election.cc:304] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:51.702589  5523 raft_consensus.cc:2804] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:51.703040  5523 raft_consensus.cc:697] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:51.703828  5523 consensus_queue.cc:237] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.705297  5263 tablet_bootstrap.cc:492] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:51.706889  5263 ts_tablet_manager.cc:1403] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.002s
I20260709 12:25:51.703852  5113 leader_election.cc:304] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:51.694123  5441 raft_consensus.cc:515] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.710704  5344 raft_consensus.cc:2804] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:51.712533  5344 raft_consensus.cc:493] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.712932  5344 raft_consensus.cc:3060] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:51.718909  5265 raft_consensus.cc:359] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.719646  5265 raft_consensus.cc:385] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.719941  5265 raft_consensus.cc:740] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.720685  5265 consensus_queue.cc:260] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.721313  5512 consensus_queue.cc:1048] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:51.723970  5421 leader_election.cc:290] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:51.733239  5265 ts_tablet_manager.cc:1434] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 12:25:51.740474  5265 tablet_bootstrap.cc:492] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:51.735812  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f424fe8428004213860887c1e4ed5796" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:51.744962  5145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253cc4e85c5b4c18ac746b32b0a47e47" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:51.745600  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253cc4e85c5b4c18ac746b32b0a47e47" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:51.746246  5221 raft_consensus.cc:3060] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:51.746315  5037 leader_election.cc:343] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:51.747360  5114 leader_election.cc:343] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:51.747640  4970 catalog_manager.cc:5697] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:51.750742  5344 raft_consensus.cc:515] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.753669  5344 leader_election.cc:290] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:51.754176  5424 raft_consensus.cc:493] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.752312  5263 raft_consensus.cc:359] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.757118  5263 raft_consensus.cc:385] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.758273  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f424fe8428004213860887c1e4ed5796" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:51.758486  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f424fe8428004213860887c1e4ed5796" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:51.757426  5263 raft_consensus.cc:740] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.758874  5073 raft_consensus.cc:3060] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:51.760463  5288 raft_consensus.cc:493] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.760969  5288 raft_consensus.cc:515] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.754675  5424 raft_consensus.cc:515] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.765365  5424 leader_election.cc:290] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:51.765475  5145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e28bbe53df40bda7a921f79ae0514f" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:51.765556  5069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e28bbe53df40bda7a921f79ae0514f" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:51.753008  5441 leader_election.cc:290] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
W20260709 12:25:51.762629  5114 leader_election.cc:343] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:51.762892  5288 leader_election.cc:290] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:51.767757  5069 raft_consensus.cc:2468] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:51.768399  5145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863b6a5fcc24d979cc005aaef6827ae" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:51.772789  5145 raft_consensus.cc:2468] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
W20260709 12:25:51.768458  5186 leader_election.cc:343] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:51.769413  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863b6a5fcc24d979cc005aaef6827ae" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:51.774982  5070 raft_consensus.cc:2468] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:51.775564  5073 raft_consensus.cc:2468] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:51.776224  5187 leader_election.cc:304] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:51.777441  5113 leader_election.cc:304] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:51.777544  5187 leader_election.cc:304] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:51.778784  5512 raft_consensus.cc:2804] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:51.779286  5512 raft_consensus.cc:697] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:25:51.779789  5221 raft_consensus.cc:2468] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:51.780126  5512 consensus_queue.cc:237] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.780439  5265 tablet_bootstrap.cc:654] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.781783  5288 raft_consensus.cc:2804] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:51.782172  5288 raft_consensus.cc:493] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.782536  5288 raft_consensus.cc:3060] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:51.785804  5522 raft_consensus.cc:2804] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:51.786345  5522 raft_consensus.cc:493] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.786799  5522 raft_consensus.cc:3060] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:51.788774  5523 raft_consensus.cc:493] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.788980  5039 leader_election.cc:304] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:51.789278  5523 raft_consensus.cc:515] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.791121  5322 raft_consensus.cc:2804] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:51.791744  5322 raft_consensus.cc:697] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:51.792599  5145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650634415db46289a46381b54dde329" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:51.792935  5322 consensus_queue.cc:237] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
W20260709 12:25:51.794142  5037 leader_election.cc:343] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:51.797564  5523 leader_election.cc:290] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:51.803830  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650634415db46289a46381b54dde329" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
W20260709 12:25:51.805723  5039 leader_election.cc:343] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:51.806141  5039 leader_election.cc:304] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:51.808682  5305 raft_consensus.cc:2749] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:51.767557  5263 consensus_queue.cc:260] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.816920  5511 consensus_queue.cc:1048] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:51.819219  4970 catalog_manager.cc:5697] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 0 to 1, leader changed from <none> to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:51.839757  5145 raft_consensus.cc:3060] T e5b732ffbeea492c9c4d91376c781263 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:51.870091  5263 ts_tablet_manager.cc:1434] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.163s	user 0.008s	sys 0.000s
I20260709 12:25:51.877341  5273 raft_consensus.cc:493] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.877898  5273 raft_consensus.cc:515] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.879573  5273 leader_election.cc:290] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:51.770920  5262 tablet_bootstrap.cc:654] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.882226  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9c81422e73491dba294f24607e5e84" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
W20260709 12:25:51.883438  5186 leader_election.cc:343] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:51.883595  5273 raft_consensus.cc:493] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.884491  5273 raft_consensus.cc:515] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.886399  5273 leader_election.cc:290] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:51.877040  5522 raft_consensus.cc:515] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.888235  5467 consensus_queue.cc:1048] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:51.890239  5288 raft_consensus.cc:515] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.891748  5265 tablet_bootstrap.cc:492] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:51.892197  5265 ts_tablet_manager.cc:1403] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.152s	user 0.028s	sys 0.015s
I20260709 12:25:51.896775  5322 raft_consensus.cc:493] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.897277  5322 raft_consensus.cc:515] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.897873  5263 tablet_bootstrap.cc:492] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:51.900213  5322 leader_election.cc:290] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:51.906183  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9c81422e73491dba294f24607e5e84" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:51.907027  5222 raft_consensus.cc:2468] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:51.900758  5265 raft_consensus.cc:359] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.909185  5265 raft_consensus.cc:385] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.909547  5265 raft_consensus.cc:740] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.909907  5039 leader_election.cc:304] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:51.910485  5265 consensus_queue.cc:260] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.913172  5441 raft_consensus.cc:2804] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:51.913607  5441 raft_consensus.cc:493] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.913905  5441 raft_consensus.cc:3060] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:51.918282  5441 raft_consensus.cc:515] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.921456  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9c81422e73491dba294f24607e5e84" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:51.922000  5222 raft_consensus.cc:3060] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:51.911918  4969 catalog_manager.cc:5697] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:51.902320  5288 leader_election.cc:290] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:51.929189  5265 ts_tablet_manager.cc:1434] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:25:51.939241  5222 raft_consensus.cc:2468] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:51.941453  5262 tablet_bootstrap.cc:492] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:51.941943  5262 ts_tablet_manager.cc:1403] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.269s	user 0.018s	sys 0.013s
I20260709 12:25:51.910706  5522 leader_election.cc:290] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:51.924667  5344 raft_consensus.cc:493] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.947116  5265 tablet_bootstrap.cc:492] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:51.925122  5441 leader_election.cc:290] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:51.966364  5039 leader_election.cc:304] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:51.952916  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9c81422e73491dba294f24607e5e84" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:51.954672  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e28bbe53df40bda7a921f79ae0514f" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:51.951021  5142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f147c4f5ae9479dae2779366c7cf2fe" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:51.952061  5146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863b6a5fcc24d979cc005aaef6827ae" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:51.952486  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9c81422e73491dba294f24607e5e84" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:51.967959  5424 raft_consensus.cc:493] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.953615  5344 raft_consensus.cc:515] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.969321  5441 raft_consensus.cc:2804] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:51.982714  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9c81422e73491dba294f24607e5e84" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:51.984757  5262 raft_consensus.cc:359] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:51.985587  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f147c4f5ae9479dae2779366c7cf2fe" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:52.001339  5262 raft_consensus.cc:385] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.986481  5424 raft_consensus.cc:515] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.002600  5441 raft_consensus.cc:697] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:51.990919  5344 leader_election.cc:290] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:51.993052  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04afa18a0a324c0d9788a17d1182585b" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:51.993502  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04afa18a0a324c0d9788a17d1182585b" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:51.982230  5146 raft_consensus.cc:3060] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:52.000437  5186 leader_election.cc:343] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.001783  5262 raft_consensus.cc:740] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.009150  5262 consensus_queue.cc:260] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.010278  5073 raft_consensus.cc:2468] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:52.011010  5424 leader_election.cc:290] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:52.012143  5441 consensus_queue.cc:237] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.013154  5113 leader_election.cc:304] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:52.014557  5511 raft_consensus.cc:2804] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:52.014963  5511 raft_consensus.cc:493] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.015308  5511 raft_consensus.cc:3060] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.003734  5263 tablet_bootstrap.cc:654] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:52.017097  5186 leader_election.cc:343] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.027228  5262 ts_tablet_manager.cc:1434] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.085s	user 0.010s	sys 0.001s
I20260709 12:25:52.028162  5262 tablet_bootstrap.cc:492] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:52.034526  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f424fe8428004213860887c1e4ed5796" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
W20260709 12:25:52.029034  5114 leader_election.cc:343] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.037506  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863b6a5fcc24d979cc005aaef6827ae" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:52.038232  5073 raft_consensus.cc:3060] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:52.024688  5037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 51128.7us
W20260709 12:25:52.040470  5037 leader_election.cc:343] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:52.043527  5187 leader_election.cc:343] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.044013  5187 leader_election.cc:304] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:52.045284  5522 raft_consensus.cc:2749] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:52.046564  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e28bbe53df40bda7a921f79ae0514f" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:52.048846  5070 raft_consensus.cc:3060] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.053237  5065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f424fe8428004213860887c1e4ed5796" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:52.054109  5065 raft_consensus.cc:2393] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e72ecbdf12a4160856b2a57422118a3 in current term 1: Already voted for candidate d22f4ab7b09f42258209170e7c9214cb in this term.
W20260709 12:25:52.045506  5037 leader_election.cc:343] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.065227  5265 tablet_bootstrap.cc:654] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.065068  5146 raft_consensus.cc:2468] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:52.075668  5186 leader_election.cc:304] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:52.077132  5559 raft_consensus.cc:2804] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:52.077711  5559 raft_consensus.cc:697] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:25:52.093130  4968 catalog_manager.cc:5697] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:52.078613  5559 consensus_queue.cc:237] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.096992  5070 raft_consensus.cc:2468] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:52.099428  5262 tablet_bootstrap.cc:654] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.095062  5073 raft_consensus.cc:2468] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:52.109126  5263 tablet_bootstrap.cc:492] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:52.109606  5263 ts_tablet_manager.cc:1403] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.212s	user 0.006s	sys 0.010s
I20260709 12:25:52.107234  5511 raft_consensus.cc:515] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.099695  5187 leader_election.cc:304] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:52.113773  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04afa18a0a324c0d9788a17d1182585b" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:52.114490  5424 raft_consensus.cc:3060] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.106688  5305 consensus_queue.cc:1048] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:25:52.117030  5511 leader_election.cc:290] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:52.122731  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04afa18a0a324c0d9788a17d1182585b" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
W20260709 12:25:52.124293  5114 leader_election.cc:343] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.114485  5187 leader_election.cc:304] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:52.114548  5072 raft_consensus.cc:3060] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.131511  5263 raft_consensus.cc:359] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.132463  5263 raft_consensus.cc:385] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.135097  5263 raft_consensus.cc:740] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.135828  5263 consensus_queue.cc:260] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.139950  5263 ts_tablet_manager.cc:1434] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:25:52.140005  5072 raft_consensus.cc:2468] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:52.145433  5113 leader_election.cc:304] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:52.146495  5511 raft_consensus.cc:2804] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:52.147109  5511 raft_consensus.cc:697] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:25:52.147866  5511 consensus_queue.cc:237] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.151880  5265 tablet_bootstrap.cc:492] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:52.152438  5265 ts_tablet_manager.cc:1403] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.205s	user 0.025s	sys 0.007s
I20260709 12:25:52.154909  5265 raft_consensus.cc:359] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.155416  5265 raft_consensus.cc:385] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.155690  5265 raft_consensus.cc:740] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.156283  5265 consensus_queue.cc:260] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.157956  5265 ts_tablet_manager.cc:1434] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:52.158823  5265 tablet_bootstrap.cc:492] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:52.161258  4968 catalog_manager.cc:5697] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:52.141328  5263 tablet_bootstrap.cc:492] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:52.142297  5559 raft_consensus.cc:2749] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:52.142807  5187 leader_election.cc:304] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:52.164546  5559 raft_consensus.cc:2804] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:52.164911  5037 consensus_peers.cc:597] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:52.165035  5559 raft_consensus.cc:697] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:25:52.165875  5559 consensus_queue.cc:237] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.168278  5265 tablet_bootstrap.cc:654] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.174269  4969 catalog_manager.cc:5697] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 0 to 1, leader changed from <none> to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:52.185482  5265 tablet_bootstrap.cc:492] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:52.186055  5265 ts_tablet_manager.cc:1403] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 12:25:52.193416  5424 raft_consensus.cc:2749] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:52.198279  5262 tablet_bootstrap.cc:492] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:52.200027  5262 ts_tablet_manager.cc:1403] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.172s	user 0.028s	sys 0.018s
I20260709 12:25:52.202898  5262 raft_consensus.cc:359] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.203433  5262 raft_consensus.cc:385] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.203685  5262 raft_consensus.cc:740] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.204206  5262 consensus_queue.cc:260] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.205576  5262 ts_tablet_manager.cc:1434] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.003s
I20260709 12:25:52.207784  5263 tablet_bootstrap.cc:654] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.210702  5265 raft_consensus.cc:359] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.211381  5265 raft_consensus.cc:385] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.211670  5262 tablet_bootstrap.cc:492] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:52.213794  5288 raft_consensus.cc:493] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.211635  5265 raft_consensus.cc:740] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.214265  5288 raft_consensus.cc:515] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.215212  5265 consensus_queue.cc:260] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.215694  4968 catalog_manager.cc:5697] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:52.217690  5265 ts_tablet_manager.cc:1434] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.001s
I20260709 12:25:52.218113  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a90aff4ede48ad8c6ef5d2ca6c1a5c" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:52.218655  5265 tablet_bootstrap.cc:492] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
W20260709 12:25:52.219602  5187 leader_election.cc:343] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.216282  5288 leader_election.cc:290] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:52.221702  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a90aff4ede48ad8c6ef5d2ca6c1a5c" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:52.224083  5262 tablet_bootstrap.cc:654] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:52.225193  5186 leader_election.cc:343] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.225574  5186 leader_election.cc:304] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:52.229707  5305 consensus_queue.cc:1048] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:52.230702  5288 raft_consensus.cc:2749] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:52.246635  5265 tablet_bootstrap.cc:654] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.250454  5262 tablet_bootstrap.cc:492] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:52.250994  5262 ts_tablet_manager.cc:1403] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.016s
I20260709 12:25:52.254130  5262 raft_consensus.cc:359] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.254833  5262 raft_consensus.cc:385] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.255143  5262 raft_consensus.cc:740] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.250649  5263 tablet_bootstrap.cc:492] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:52.256217  5263 ts_tablet_manager.cc:1403] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.115s	user 0.018s	sys 0.005s
I20260709 12:25:52.255971  5262 consensus_queue.cc:260] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.258839  5262 ts_tablet_manager.cc:1434] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:52.260042  5262 tablet_bootstrap.cc:492] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:52.267567  5262 tablet_bootstrap.cc:654] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.268004  5511 consensus_queue.cc:1048] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:52.264426  5263 raft_consensus.cc:359] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.269759  5263 raft_consensus.cc:385] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.270164  5263 raft_consensus.cc:740] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.270792  5263 consensus_queue.cc:260] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
W20260709 12:25:52.271173  5037 consensus_peers.cc:597] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:52.279009  5263 ts_tablet_manager.cc:1434] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:25:52.280772  5265 tablet_bootstrap.cc:492] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:52.281314  5265 ts_tablet_manager.cc:1403] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.007s
I20260709 12:25:52.283851  5265 raft_consensus.cc:359] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.285086  5263 tablet_bootstrap.cc:492] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:52.292004  5263 tablet_bootstrap.cc:654] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.284490  5265 raft_consensus.cc:385] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.295452  5265 raft_consensus.cc:740] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.296113  5265 consensus_queue.cc:260] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.297379  5265 ts_tablet_manager.cc:1434] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:25:52.298096  5265 tablet_bootstrap.cc:492] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:52.302924  5262 tablet_bootstrap.cc:492] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:52.303396  5262 ts_tablet_manager.cc:1403] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.000s
I20260709 12:25:52.303522  5511 consensus_queue.cc:1048] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:52.306128  5262 raft_consensus.cc:359] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.306983  5262 raft_consensus.cc:385] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.307336  5262 raft_consensus.cc:740] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.308370  5262 consensus_queue.cc:260] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.312844  5262 ts_tablet_manager.cc:1434] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:25:52.314080  5262 tablet_bootstrap.cc:492] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:52.318611  5265 tablet_bootstrap.cc:654] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.340314  5441 raft_consensus.cc:493] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.340878  5441 raft_consensus.cc:515] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.344395  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a90aff4ede48ad8c6ef5d2ca6c1a5c" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
W20260709 12:25:52.351701  5037 leader_election.cc:343] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.351905  5265 tablet_bootstrap.cc:492] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:52.352545  5265 ts_tablet_manager.cc:1403] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.000s
I20260709 12:25:52.352583  5441 leader_election.cc:290] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:52.353842  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a90aff4ede48ad8c6ef5d2ca6c1a5c" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:52.354552  5263 tablet_bootstrap.cc:492] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:52.354480  5221 raft_consensus.cc:2468] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:52.355029  5263 ts_tablet_manager.cc:1403] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.070s	user 0.031s	sys 0.014s
I20260709 12:25:52.355837  5039 leader_election.cc:304] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:52.355865  5265 raft_consensus.cc:359] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.357070  5265 raft_consensus.cc:385] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.358212  5441 raft_consensus.cc:2804] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:52.358421  5265 raft_consensus.cc:740] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.358825  5441 raft_consensus.cc:493] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.358741  5263 raft_consensus.cc:359] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.359310  5441 raft_consensus.cc:3060] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.359477  5263 raft_consensus.cc:385] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.346947  5262 tablet_bootstrap.cc:654] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.367049  5441 raft_consensus.cc:515] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.367769  5263 raft_consensus.cc:740] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.368453  5263 consensus_queue.cc:260] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.359244  5265 consensus_queue.cc:260] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.370532  5263 ts_tablet_manager.cc:1434] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:25:52.371392  5265 ts_tablet_manager.cc:1434] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 12:25:52.372277  5265 tablet_bootstrap.cc:492] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:52.373909  5441 leader_election.cc:290] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:52.374001  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a90aff4ede48ad8c6ef5d2ca6c1a5c" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:52.380146  5221 raft_consensus.cc:3060] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.374519  5263 tablet_bootstrap.cc:492] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:52.379259  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a90aff4ede48ad8c6ef5d2ca6c1a5c" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
W20260709 12:25:52.382543  5037 leader_election.cc:343] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.385257  5262 tablet_bootstrap.cc:492] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:52.385707  5262 ts_tablet_manager.cc:1403] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.007s
I20260709 12:25:52.387475  5263 tablet_bootstrap.cc:654] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.378190  5265 tablet_bootstrap.cc:654] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.390051  5221 raft_consensus.cc:2468] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:52.394075  5262 raft_consensus.cc:359] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.395136  5262 raft_consensus.cc:385] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.395491  5262 raft_consensus.cc:740] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.396327  5262 consensus_queue.cc:260] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.398144  5039 leader_election.cc:304] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:52.399222  5560 raft_consensus.cc:2804] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:52.400067  5560 raft_consensus.cc:697] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:52.401095  5560 consensus_queue.cc:237] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.406399  5262 ts_tablet_manager.cc:1434] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 12:25:52.407452  5262 tablet_bootstrap.cc:492] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:52.436679  5262 tablet_bootstrap.cc:654] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.436792  5265 tablet_bootstrap.cc:492] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:52.437242  5265 ts_tablet_manager.cc:1403] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.024s
I20260709 12:25:52.437534  5263 tablet_bootstrap.cc:492] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:52.438328  5263 ts_tablet_manager.cc:1403] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.064s	user 0.025s	sys 0.029s
I20260709 12:25:52.439782  5441 consensus_queue.cc:1048] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:52.440513  5265 raft_consensus.cc:359] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.440927  5263 raft_consensus.cc:359] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.441433  5265 raft_consensus.cc:385] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.441785  5263 raft_consensus.cc:385] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.441812  5265 raft_consensus.cc:740] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.442263  5263 raft_consensus.cc:740] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.442853  5265 consensus_queue.cc:260] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.443445  5263 consensus_queue.cc:260] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.444582  5344 raft_consensus.cc:493] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.445025  5344 raft_consensus.cc:515] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.445701  5265 ts_tablet_manager.cc:1434] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:52.446165  5263 ts_tablet_manager.cc:1434] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:52.446744  5265 tablet_bootstrap.cc:492] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:52.447033  5344 leader_election.cc:290] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:52.447154  5263 tablet_bootstrap.cc:492] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:52.448312  5262 tablet_bootstrap.cc:492] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:52.448768  5262 ts_tablet_manager.cc:1403] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.042s	user 0.006s	sys 0.012s
I20260709 12:25:52.449750  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f147c4f5ae9479dae2779366c7cf2fe" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
W20260709 12:25:52.451596  5113 leader_election.cc:343] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.452982  5265 tablet_bootstrap.cc:654] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.454668  5263 tablet_bootstrap.cc:654] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.456939  5262 raft_consensus.cc:359] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.457837  5262 raft_consensus.cc:385] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.458180  5262 raft_consensus.cc:740] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.459211  5262 consensus_queue.cc:260] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.462080  5262 ts_tablet_manager.cc:1434] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:25:52.463591  5305 raft_consensus.cc:493] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.463426  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f147c4f5ae9479dae2779366c7cf2fe" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:52.464051  5305 raft_consensus.cc:515] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.464283  5221 raft_consensus.cc:2468] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:52.465857  5305 leader_election.cc:290] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:52.466964  5114 leader_election.cc:304] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:25:52.468964  5467 raft_consensus.cc:2804] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:52.469385  5467 raft_consensus.cc:493] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.469777  5467 raft_consensus.cc:3060] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.469045  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07469c82367d44f58e1a33659fefd477" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:52.482350  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07469c82367d44f58e1a33659fefd477" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
W20260709 12:25:52.483747  5037 leader_election.cc:343] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.485391  5221 raft_consensus.cc:2468] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:52.486860  5039 leader_election.cc:304] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:52.488411  5560 raft_consensus.cc:2804] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:52.488793  5560 raft_consensus.cc:493] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.489141  5560 raft_consensus.cc:3060] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.498605  5467 raft_consensus.cc:515] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.502507  5467 leader_election.cc:290] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:52.507437  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f147c4f5ae9479dae2779366c7cf2fe" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:52.508098  5070 raft_consensus.cc:3060] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.508177  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f147c4f5ae9479dae2779366c7cf2fe" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:52.509143  5220 raft_consensus.cc:3060] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.515404  5070 raft_consensus.cc:2468] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:52.515774  5305 raft_consensus.cc:493] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.516134  5262 tablet_bootstrap.cc:492] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:52.516281  5305 raft_consensus.cc:515] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.518102  4968 catalog_manager.cc:5697] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:52.523278  5305 leader_election.cc:290] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:52.540771  5262 tablet_bootstrap.cc:654] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.542672  5142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3a3a987e8c145f484b2c0aa9890ed20" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
W20260709 12:25:52.544880  5037 leader_election.cc:343] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.539950  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3a3a987e8c145f484b2c0aa9890ed20" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:52.542038  5113 leader_election.cc:304] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:52.550316  5511 raft_consensus.cc:493] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.550784  5511 raft_consensus.cc:515] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.552438  5344 raft_consensus.cc:2804] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:52.552970  5344 raft_consensus.cc:697] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
W20260709 12:25:52.554312  5039 leader_election.cc:343] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.554737  5039 leader_election.cc:304] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:52.554220  5220 raft_consensus.cc:2468] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:52.561328  5220 raft_consensus.cc:3060] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.553787  5344 consensus_queue.cc:237] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.563426  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253cc4e85c5b4c18ac746b32b0a47e47" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:52.566388  5511 leader_election.cc:290] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:52.567384  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253cc4e85c5b4c18ac746b32b0a47e47" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:52.568851  5114 leader_election.cc:304] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:52.570364  5511 raft_consensus.cc:2749] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:52.571465  5265 tablet_bootstrap.cc:492] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:52.564162  5587 raft_consensus.cc:2749] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:52.578444  5511 raft_consensus.cc:493] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.578909  5511 raft_consensus.cc:515] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.585685  5511 leader_election.cc:290] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:52.587018  5265 ts_tablet_manager.cc:1403] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.140s	user 0.040s	sys 0.034s
I20260709 12:25:52.587622  5263 tablet_bootstrap.cc:492] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:52.588112  5263 ts_tablet_manager.cc:1403] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.141s	user 0.029s	sys 0.016s
I20260709 12:25:52.588985  5511 consensus_queue.cc:1048] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:52.593130  5559 raft_consensus.cc:493] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.594441  5559 raft_consensus.cc:515] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.595511  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e28bbe53df40bda7a921f79ae0514f" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:52.597990  5070 raft_consensus.cc:2393] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d22f4ab7b09f42258209170e7c9214cb in current term 1: Already voted for candidate 6e72ecbdf12a4160856b2a57422118a3 in this term.
I20260709 12:25:52.608193  5262 tablet_bootstrap.cc:492] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:52.608886  5262 ts_tablet_manager.cc:1403] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.146s	user 0.020s	sys 0.004s
I20260709 12:25:52.611364  5559 leader_election.cc:290] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:52.613078  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d91e17c8c3b4cac9a128316050ce7df" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:52.613533  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d91e17c8c3b4cac9a128316050ce7df" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:52.614168  5265 raft_consensus.cc:359] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.614822  5265 raft_consensus.cc:385] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.615079  5265 raft_consensus.cc:740] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.609781  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e28bbe53df40bda7a921f79ae0514f" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:52.615710  5265 consensus_queue.cc:260] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.616798  5114 leader_election.cc:304] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:52.618263  5265 ts_tablet_manager.cc:1434] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 12:25:52.619072  5265 tablet_bootstrap.cc:492] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
W20260709 12:25:52.620728  5187 leader_election.cc:343] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:52.622684  5186 leader_election.cc:343] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.623113  5186 leader_election.cc:304] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:52.622887  5560 raft_consensus.cc:515] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.623843  5559 raft_consensus.cc:2749] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:52.624771  5511 raft_consensus.cc:3060] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.625031  5560 leader_election.cc:290] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:52.629596  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07469c82367d44f58e1a33659fefd477" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:52.630223  5220 raft_consensus.cc:3060] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.631335  5263 raft_consensus.cc:359] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.631078  4968 catalog_manager.cc:5697] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 0 to 1, leader changed from <none> to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:52.629635  5037 consensus_peers.cc:597] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:52.630254  5142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07469c82367d44f58e1a33659fefd477" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
W20260709 12:25:52.633495  5037 leader_election.cc:343] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.635809  5344 raft_consensus.cc:493] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.636279  5344 raft_consensus.cc:515] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.638365  5344 leader_election.cc:290] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:52.640199  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c924d344cb49639d42d3f21aa08cf2" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:52.644734  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c924d344cb49639d42d3f21aa08cf2" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:52.646183  5114 leader_election.cc:304] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:52.646528  5220 raft_consensus.cc:2468] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:52.646976  5344 raft_consensus.cc:2749] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:52.647256  5511 raft_consensus.cc:2749] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:52.647966  5556 raft_consensus.cc:493] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.647931  5039 leader_election.cc:304] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:52.648720  5265 tablet_bootstrap.cc:654] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.648661  5556 raft_consensus.cc:515] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.649436  5560 raft_consensus.cc:2804] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:52.649991  5560 raft_consensus.cc:697] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:52.632072  5263 raft_consensus.cc:385] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.650887  5560 consensus_queue.cc:237] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.651577  5263 raft_consensus.cc:740] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.652284  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650634415db46289a46381b54dde329" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:52.653139  5070 raft_consensus.cc:2468] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:52.654826  5187 leader_election.cc:304] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:52.655898  5559 raft_consensus.cc:2804] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:52.656355  5559 raft_consensus.cc:493] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.656791  5559 raft_consensus.cc:3060] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.635818  5262 raft_consensus.cc:359] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.658316  5262 raft_consensus.cc:385] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.658571  5262 raft_consensus.cc:740] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.660938  5424 consensus_queue.cc:1048] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:52.659188  5262 consensus_queue.cc:260] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.662964  5262 ts_tablet_manager.cc:1434] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.001s
I20260709 12:25:52.663858  5262 tablet_bootstrap.cc:492] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:52.670015  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650634415db46289a46381b54dde329" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
W20260709 12:25:52.675222  5186 leader_election.cc:343] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.675915  5556 leader_election.cc:290] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:52.652308  5263 consensus_queue.cc:260] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.684180  5522 consensus_queue.cc:1048] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:52.687968  5471 consensus_queue.cc:1048] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:52.706923  5263 ts_tablet_manager.cc:1434] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.118s	user 0.005s	sys 0.002s
I20260709 12:25:52.711844  5263 tablet_bootstrap.cc:492] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:52.713999  5522 consensus_queue.cc:1048] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:52.709836  5559 raft_consensus.cc:515] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.716614  5559 leader_election.cc:290] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:52.722419  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650634415db46289a46381b54dde329" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:52.723455  5263 tablet_bootstrap.cc:654] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:52.728250  5186 leader_election.cc:343] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.728475  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650634415db46289a46381b54dde329" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:52.729058  5070 raft_consensus.cc:3060] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.738250  5070 raft_consensus.cc:2468] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:52.740070  5187 leader_election.cc:304] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:52.741716  5559 consensus_queue.cc:1048] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:52.743505  5559 raft_consensus.cc:2804] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:52.744074  5559 raft_consensus.cc:697] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:25:52.751389  5559 consensus_queue.cc:237] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.754747  5142 raft_consensus.cc:3060] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.757457  5263 tablet_bootstrap.cc:492] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:52.758033  5263 ts_tablet_manager.cc:1403] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.002s
I20260709 12:25:52.761518  5263 raft_consensus.cc:359] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.762705  5263 raft_consensus.cc:385] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.763121  5263 raft_consensus.cc:740] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.763854  5147 raft_consensus.cc:3060] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.764093  5263 consensus_queue.cc:260] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.768190  5262 tablet_bootstrap.cc:654] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.780366  5263 ts_tablet_manager.cc:1434] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:25:52.788028  5263 tablet_bootstrap.cc:492] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:52.788334  5265 tablet_bootstrap.cc:492] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:52.783327  5267 raft_consensus.cc:493] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.788826  5265 ts_tablet_manager.cc:1403] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.170s	user 0.045s	sys 0.095s
I20260709 12:25:52.788944  5267 raft_consensus.cc:515] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.794737  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70fcd244ec422c887a45f476de45f1" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
W20260709 12:25:52.796766  5037 leader_election.cc:343] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.803328  5267 leader_election.cc:290] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:52.804850  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70fcd244ec422c887a45f476de45f1" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:52.813043  5221 raft_consensus.cc:2468] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:52.809412  5265 raft_consensus.cc:359] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.813947  5265 raft_consensus.cc:385] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.814302  5265 raft_consensus.cc:740] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.815182  5039 leader_election.cc:304] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:52.815815  5265 consensus_queue.cc:260] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.816592  5560 raft_consensus.cc:2804] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:52.816977  5560 raft_consensus.cc:493] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.817327  5560 raft_consensus.cc:3060] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.818159  5265 ts_tablet_manager.cc:1434] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:25:52.819422  5265 tablet_bootstrap.cc:492] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:52.821548  5263 tablet_bootstrap.cc:654] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.822050  5144 raft_consensus.cc:3060] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.827667  5265 tablet_bootstrap.cc:654] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.832268  4969 catalog_manager.cc:5697] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:52.834856  5587 consensus_queue.cc:1048] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:52.839706  5265 tablet_bootstrap.cc:492] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:52.840256  5265 ts_tablet_manager.cc:1403] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.012s
I20260709 12:25:52.842077  5560 raft_consensus.cc:515] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.844285  5263 tablet_bootstrap.cc:492] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:52.844720  5263 ts_tablet_manager.cc:1403] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.004s
I20260709 12:25:52.847291  5263 raft_consensus.cc:359] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.847885  5263 raft_consensus.cc:385] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.848137  5263 raft_consensus.cc:740] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.849856  4970 catalog_manager.cc:5697] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:52.854697  5263 consensus_queue.cc:260] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.855822  5265 raft_consensus.cc:359] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.856922  5263 ts_tablet_manager.cc:1434] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:25:52.856963  5265 raft_consensus.cc:385] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.857551  5265 raft_consensus.cc:740] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.857860  5263 tablet_bootstrap.cc:492] T 07469c82367d44f58e1a33659fefd477 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:52.858500  5265 consensus_queue.cc:260] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.865633  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70fcd244ec422c887a45f476de45f1" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:52.867113  5560 leader_election.cc:290] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
W20260709 12:25:52.869000  5037 leader_election.cc:343] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.868191  5322 consensus_queue.cc:1048] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:52.871949  5263 tablet_bootstrap.cc:654] T 07469c82367d44f58e1a33659fefd477 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.875224  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70fcd244ec422c887a45f476de45f1" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:52.876019  5221 raft_consensus.cc:3060] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.884606  5263 tablet_bootstrap.cc:492] T 07469c82367d44f58e1a33659fefd477 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:52.885216  5263 ts_tablet_manager.cc:1403] T 07469c82367d44f58e1a33659fefd477 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.005s
I20260709 12:25:52.888085  5263 raft_consensus.cc:359] T 07469c82367d44f58e1a33659fefd477 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.888803  5263 raft_consensus.cc:385] T 07469c82367d44f58e1a33659fefd477 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.889153  5263 raft_consensus.cc:740] T 07469c82367d44f58e1a33659fefd477 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.890626  5265 ts_tablet_manager.cc:1434] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.000s
I20260709 12:25:52.899020  5265 tablet_bootstrap.cc:492] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:52.890192  5263 consensus_queue.cc:260] T 07469c82367d44f58e1a33659fefd477 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.902628  5263 ts_tablet_manager.cc:1434] T 07469c82367d44f58e1a33659fefd477 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:25:52.903625  5263 tablet_bootstrap.cc:492] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:52.893714  5221 raft_consensus.cc:2468] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:52.916708  5262 tablet_bootstrap.cc:492] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:52.943591  5262 ts_tablet_manager.cc:1403] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.280s	user 0.013s	sys 0.004s
I20260709 12:25:52.944694  5039 leader_election.cc:304] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:52.945811  5560 raft_consensus.cc:2804] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:52.946743  5560 raft_consensus.cc:697] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:52.947309  5511 raft_consensus.cc:493] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.947842  5262 raft_consensus.cc:359] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.948109  5511 raft_consensus.cc:515] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.948545  5262 raft_consensus.cc:385] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.948843  5262 raft_consensus.cc:740] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.949379  5560 consensus_queue.cc:237] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.916786  5263 tablet_bootstrap.cc:654] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.953850  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650634415db46289a46381b54dde329" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:52.954627  5073 raft_consensus.cc:2393] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d22f4ab7b09f42258209170e7c9214cb in current term 1: Already voted for candidate 6e72ecbdf12a4160856b2a57422118a3 in this term.
I20260709 12:25:52.949457  5262 consensus_queue.cc:260] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.961572  5262 ts_tablet_manager.cc:1434] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:25:52.962347  5262 tablet_bootstrap.cc:492] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:52.963433  5511 leader_election.cc:290] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:52.967306  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650634415db46289a46381b54dde329" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
W20260709 12:25:52.968266  5018 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:52.973019  5114 leader_election.cc:304] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:52.975013  5467 raft_consensus.cc:3060] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.982810  5467 raft_consensus.cc:2749] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:52.983955  5265 tablet_bootstrap.cc:654] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.987795  4970 catalog_manager.cc:5697] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:52.993325  5262 tablet_bootstrap.cc:654] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.993789  5263 tablet_bootstrap.cc:492] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:52.994242  5263 ts_tablet_manager.cc:1403] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.014s
I20260709 12:25:52.996447  5263 raft_consensus.cc:359] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:52.997112  5263 raft_consensus.cc:385] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.999033  5263 raft_consensus.cc:740] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.998924  5467 consensus_queue.cc:1048] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:53.002457  5262 tablet_bootstrap.cc:492] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:53.002908  5262 ts_tablet_manager.cc:1403] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.002s
I20260709 12:25:53.006131  5265 tablet_bootstrap.cc:492] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:53.006682  5265 ts_tablet_manager.cc:1403] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.108s	user 0.009s	sys 0.003s
I20260709 12:25:52.999922  5263 consensus_queue.cc:260] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.010614  5263 ts_tablet_manager.cc:1434] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:25:53.011359  5263 tablet_bootstrap.cc:492] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:53.015652  5265 raft_consensus.cc:359] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.016309  5263 tablet_bootstrap.cc:654] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.017619  5467 consensus_queue.cc:1048] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:53.018199  5262 raft_consensus.cc:359] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.018836  5262 raft_consensus.cc:385] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.019090  5262 raft_consensus.cc:740] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.016330  5265 raft_consensus.cc:385] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.019969  5265 raft_consensus.cc:740] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.020731  5265 consensus_queue.cc:260] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.027101  5265 ts_tablet_manager.cc:1434] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:25:53.023094  5262 consensus_queue.cc:260] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.028417  5265 tablet_bootstrap.cc:492] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:53.029729  5262 ts_tablet_manager.cc:1434] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 12:25:53.030766  5262 tablet_bootstrap.cc:492] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:53.035264  5265 tablet_bootstrap.cc:654] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.052306  5142 raft_consensus.cc:3060] T 07469c82367d44f58e1a33659fefd477 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.059265  5288 raft_consensus.cc:493] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.059783  5288 raft_consensus.cc:515] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.059000  5267 consensus_queue.cc:1048] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:53.066488  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00dc8dae764febafe0efdc0fadcdac" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:53.067103  5073 raft_consensus.cc:2468] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:53.068156  5265 tablet_bootstrap.cc:492] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:53.068702  5265 ts_tablet_manager.cc:1403] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.010s
I20260709 12:25:53.068164  5187 leader_election.cc:304] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:53.068959  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00dc8dae764febafe0efdc0fadcdac" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:53.069795  5559 raft_consensus.cc:2804] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.070173  5559 raft_consensus.cc:493] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.070518  5559 raft_consensus.cc:3060] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.070706  5467 raft_consensus.cc:493] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.071358  5467 raft_consensus.cc:515] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.071789  5265 raft_consensus.cc:359] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.072489  5265 raft_consensus.cc:385] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.072780  5265 raft_consensus.cc:740] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
W20260709 12:25:53.073429  5186 leader_election.cc:343] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.074180  5265 consensus_queue.cc:260] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.075846  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9c81422e73491dba294f24607e5e84" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:53.076732  5265 ts_tablet_manager.cc:1434] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:53.077688  5265 tablet_bootstrap.cc:492] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:53.078271  5559 raft_consensus.cc:515] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.078490  5467 leader_election.cc:290] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:53.066497  5288 leader_election.cc:290] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:53.079279  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9c81422e73491dba294f24607e5e84" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:53.080729  5114 leader_election.cc:304] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:53.081912  5267 consensus_queue.cc:1048] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:53.081657  5467 raft_consensus.cc:2749] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:53.086548  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00dc8dae764febafe0efdc0fadcdac" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:53.087049  5072 raft_consensus.cc:3060] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.088490  5262 tablet_bootstrap.cc:654] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.089185  5265 tablet_bootstrap.cc:654] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.093258  5072 raft_consensus.cc:2468] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:53.093621  5263 tablet_bootstrap.cc:492] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:53.094099  5263 ts_tablet_manager.cc:1403] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.083s	user 0.021s	sys 0.019s
I20260709 12:25:53.094545  5187 leader_election.cc:304] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:53.095283  5288 raft_consensus.cc:2804] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:53.095867  5288 raft_consensus.cc:697] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:25:53.096910  5288 consensus_queue.cc:237] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.097721  5263 raft_consensus.cc:359] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.098614  5263 raft_consensus.cc:385] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.098933  5263 raft_consensus.cc:740] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.101153  5559 leader_election.cc:290] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:53.099777  5263 consensus_queue.cc:260] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.102384  5142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00dc8dae764febafe0efdc0fadcdac" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:53.103379  5263 ts_tablet_manager.cc:1434] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
W20260709 12:25:53.103533  5186 leader_election.cc:343] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.104224  5263 tablet_bootstrap.cc:492] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:53.107265  5559 raft_consensus.cc:493] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.107743  5559 raft_consensus.cc:515] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.110451  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccce9c827ef54c7fa65928fda3eb7acf" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:53.111265  5142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccce9c827ef54c7fa65928fda3eb7acf" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
W20260709 12:25:53.112151  5187 leader_election.cc:343] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:53.112963  5186 leader_election.cc:343] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.113402  5186 leader_election.cc:304] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:53.114279  5556 raft_consensus.cc:2749] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:53.115303  5559 leader_election.cc:290] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:53.120885  5267 raft_consensus.cc:493] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.121466  5267 raft_consensus.cc:515] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.123693  5267 leader_election.cc:290] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:53.125303  5142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034ac3e487504f54ac6e50430a0b22d7" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:53.125944  5142 raft_consensus.cc:2468] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:53.126513  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034ac3e487504f54ac6e50430a0b22d7" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
W20260709 12:25:53.127807  5039 leader_election.cc:343] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.128271  5037 leader_election.cc:304] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:53.129640  5560 raft_consensus.cc:2804] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.130151  5560 raft_consensus.cc:493] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.130592  5560 raft_consensus.cc:3060] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.199676  5587 raft_consensus.cc:493] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.200242  5587 raft_consensus.cc:515] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.202679  5587 leader_election.cc:290] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:53.228156  5471 raft_consensus.cc:493] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.228879  5471 raft_consensus.cc:515] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.237293  5471 leader_election.cc:290] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:53.238413  5262 tablet_bootstrap.cc:492] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:53.238914  5262 ts_tablet_manager.cc:1403] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.208s	user 0.013s	sys 0.014s
I20260709 12:25:53.239275  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d91e17c8c3b4cac9a128316050ce7df" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:53.239879  5221 raft_consensus.cc:2468] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:53.241883  4969 catalog_manager.cc:5697] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:53.242841  5146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d91e17c8c3b4cac9a128316050ce7df" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:53.243455  5146 raft_consensus.cc:2468] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:53.243834  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d91e17c8c3b4cac9a128316050ce7df" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:53.244438  5218 raft_consensus.cc:2468] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:53.245762  5146 raft_consensus.cc:3060] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.249094  5039 leader_election.cc:304] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:53.250397  5322 raft_consensus.cc:2804] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.250730  5322 raft_consensus.cc:493] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.251029  5322 raft_consensus.cc:3060] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.252810  5114 leader_election.cc:304] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:53.253778  5512 raft_consensus.cc:2804] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.254141  5512 raft_consensus.cc:493] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.254460  5512 raft_consensus.cc:3060] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.261049  5262 raft_consensus.cc:359] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.262660  5288 raft_consensus.cc:493] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.264458  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d91e17c8c3b4cac9a128316050ce7df" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:53.265534  5288 raft_consensus.cc:515] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.264601  5262 raft_consensus.cc:385] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.271626  5262 raft_consensus.cc:740] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.257364  5560 raft_consensus.cc:515] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.379624  5560 leader_election.cc:290] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:53.385023  5262 consensus_queue.cc:260] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.387995  5288 leader_election.cc:290] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:53.388747  5265 tablet_bootstrap.cc:492] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:53.389290  5265 ts_tablet_manager.cc:1403] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.312s	user 0.033s	sys 0.016s
W20260709 12:25:53.390501  5113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 121161us
I20260709 12:25:53.391552  5263 tablet_bootstrap.cc:700] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb: Time spent opening tablet: real 0.237s	user 0.015s	sys 0.011s
I20260709 12:25:53.391901  5262 ts_tablet_manager.cc:1434] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.153s	user 0.015s	sys 0.005s
I20260709 12:25:53.393154  5262 tablet_bootstrap.cc:492] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:53.384315  5322 raft_consensus.cc:515] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.403548  5072 raft_consensus.cc:2393] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d22f4ab7b09f42258209170e7c9214cb in current term 1: Already voted for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in this term.
I20260709 12:25:53.405156  5263 tablet_bootstrap.cc:654] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.417872  5322 leader_election.cc:290] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:53.424744  5265 raft_consensus.cc:359] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.425442  5265 raft_consensus.cc:385] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.425704  5265 raft_consensus.cc:740] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.426584  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034ac3e487504f54ac6e50430a0b22d7" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:53.427166  5144 raft_consensus.cc:3060] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.426327  5265 consensus_queue.cc:260] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.413439  5512 raft_consensus.cc:515] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.447909  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3a3a987e8c145f484b2c0aa9890ed20" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:53.448596  5070 raft_consensus.cc:2468] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 0.
I20260709 12:25:53.451555  5621 raft_consensus.cc:493] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.455014  5512 leader_election.cc:290] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:53.466831  5144 raft_consensus.cc:2468] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:53.470458  5265 ts_tablet_manager.cc:1434] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.002s
I20260709 12:25:53.475513  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034ac3e487504f54ac6e50430a0b22d7" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:53.476958  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d91e17c8c3b4cac9a128316050ce7df" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:53.479867  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d91e17c8c3b4cac9a128316050ce7df" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:53.453759  5621 raft_consensus.cc:515] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.481645  5262 tablet_bootstrap.cc:654] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.482463  5221 raft_consensus.cc:3060] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.484272  5265 tablet_bootstrap.cc:492] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:53.485895  5218 raft_consensus.cc:3060] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.490118  5143 raft_consensus.cc:2393] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in current term 1: Already voted for candidate d22f4ab7b09f42258209170e7c9214cb in this term.
I20260709 12:25:53.496522  5221 raft_consensus.cc:2468] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
W20260709 12:25:53.498005  5114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 64644.1us
I20260709 12:25:53.503600  5187 leader_election.cc:304] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:53.507038  5273 consensus_queue.cc:1048] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:53.508814  5288 raft_consensus.cc:2804] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.509166  5288 raft_consensus.cc:493] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.509521  5288 raft_consensus.cc:3060] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.532768  5072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d91e17c8c3b4cac9a128316050ce7df" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:53.533767  5072 raft_consensus.cc:2393] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d22f4ab7b09f42258209170e7c9214cb in current term 1: Already voted for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in this term.
I20260709 12:25:53.576570  5037 leader_election.cc:304] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
W20260709 12:25:53.572780  5187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 61972.8us
I20260709 12:25:53.581928  5267 raft_consensus.cc:2804] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:53.582546  5267 raft_consensus.cc:697] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
W20260709 12:25:53.585120  5039 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 60290.9us
I20260709 12:25:53.583437  5267 consensus_queue.cc:237] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.586508  5039 leader_election.cc:304] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:53.586606  5288 raft_consensus.cc:515] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.589040  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d91e17c8c3b4cac9a128316050ce7df" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:53.589557  5322 raft_consensus.cc:2804] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:53.590058  5322 raft_consensus.cc:697] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:53.591488  5222 raft_consensus.cc:2393] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d22f4ab7b09f42258209170e7c9214cb in current term 1: Already voted for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in this term.
I20260709 12:25:53.591630  5288 leader_election.cc:290] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:53.590919  5322 consensus_queue.cc:237] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.594038  5621 leader_election.cc:290] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:53.594141  5262 tablet_bootstrap.cc:492] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:53.594772  5262 ts_tablet_manager.cc:1403] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.202s	user 0.017s	sys 0.008s
I20260709 12:25:53.610270  5263 tablet_bootstrap.cc:492] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:53.610826  5263 ts_tablet_manager.cc:1403] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.507s	user 0.024s	sys 0.022s
I20260709 12:25:53.617421  5265 tablet_bootstrap.cc:654] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.626924  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3a3a987e8c145f484b2c0aa9890ed20" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:53.641070  5288 raft_consensus.cc:493] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.641119  5262 raft_consensus.cc:359] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.641935  5262 raft_consensus.cc:385] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.641702  5288 raft_consensus.cc:515] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.642204  5262 raft_consensus.cc:740] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.642789  5262 consensus_queue.cc:260] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.643425  5288 leader_election.cc:290] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:53.645291  5262 ts_tablet_manager.cc:1434] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 12:25:53.646528  5262 tablet_bootstrap.cc:492] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:53.648895  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3a3a987e8c145f484b2c0aa9890ed20" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:53.649508  5070 raft_consensus.cc:3060] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.653415  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccce9c827ef54c7fa65928fda3eb7acf" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:53.654026  5222 raft_consensus.cc:2468] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:53.664013  5039 leader_election.cc:304] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:53.665815  5070 raft_consensus.cc:2468] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:25:53.666875  5322 raft_consensus.cc:2804] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.667318  5322 raft_consensus.cc:493] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.667629  5322 raft_consensus.cc:3060] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.666790  5267 consensus_queue.cc:1048] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:53.680218  5322 raft_consensus.cc:515] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.671671  5218 raft_consensus.cc:2468] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:53.688521  5262 tablet_bootstrap.cc:654] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.718437  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccce9c827ef54c7fa65928fda3eb7acf" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:53.722522  5322 leader_election.cc:290] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
W20260709 12:25:53.735249  5114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 98997.4us
I20260709 12:25:53.693109  5066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f0b7d7401864a6cadec140ae4603df6" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:53.734720  5187 leader_election.cc:304] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:25:53.740079  5273 raft_consensus.cc:2804] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:53.690909  5113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 150082us
W20260709 12:25:53.744019  5037 leader_election.cc:343] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:53.745935  5037 consensus_peers.cc:597] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:53.738869  5556 consensus_queue.cc:1048] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:25:53.771368  5263 raft_consensus.cc:359] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.769240  5145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f0b7d7401864a6cadec140ae4603df6" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:53.772157  5263 raft_consensus.cc:385] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.774010  5263 raft_consensus.cc:740] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.774808  5263 consensus_queue.cc:260] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.777279  5263 ts_tablet_manager.cc:1434] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.166s	user 0.006s	sys 0.001s
I20260709 12:25:53.778743  5273 raft_consensus.cc:697] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:25:53.779631  5273 consensus_queue.cc:237] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.776445  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3a3a987e8c145f484b2c0aa9890ed20" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:53.798082  5265 tablet_bootstrap.cc:492] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:53.798794  5265 ts_tablet_manager.cc:1403] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.315s	user 0.024s	sys 0.042s
I20260709 12:25:53.792148  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccce9c827ef54c7fa65928fda3eb7acf" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
W20260709 12:25:53.797617  5113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 49790.2us
I20260709 12:25:53.803512  5113 leader_election.cc:304] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
W20260709 12:25:53.808311  5037 leader_election.cc:343] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:53.819272  5186 leader_election.cc:343] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.823210  5624 raft_consensus.cc:2749] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:53.823694  5262 tablet_bootstrap.cc:492] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:53.824180  5262 ts_tablet_manager.cc:1403] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.178s	user 0.009s	sys 0.009s
W20260709 12:25:53.826112  5186 consensus_peers.cc:597] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:53.826617  5186 leader_election.cc:343] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:53.827065  5186 leader_election.cc:343] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.824380  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccce9c827ef54c7fa65928fda3eb7acf" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:53.836290  5631 consensus_queue.cc:1048] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:25:53.839175  5621 raft_consensus.cc:493] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.839860  5621 raft_consensus.cc:515] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.842875  5621 leader_election.cc:290] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:53.833451  5220 raft_consensus.cc:3060] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.854326  5262 raft_consensus.cc:359] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.855223  5262 raft_consensus.cc:385] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.855571  5262 raft_consensus.cc:740] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.857364  5262 consensus_queue.cc:260] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.859354  5263 tablet_bootstrap.cc:492] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:53.879951  5265 raft_consensus.cc:359] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.880699  5265 raft_consensus.cc:385] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.881255  5265 raft_consensus.cc:740] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.884756  5263 tablet_bootstrap.cc:654] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.886745  5265 consensus_queue.cc:260] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.892867  4969 catalog_manager.cc:5697] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.894573  5220 raft_consensus.cc:2468] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:53.894505  4969 catalog_manager.cc:5697] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.897251  5265 ts_tablet_manager.cc:1434] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.001s
W20260709 12:25:53.897727  5114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 81539.1us
I20260709 12:25:53.900019  5265 tablet_bootstrap.cc:492] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:53.902279  4968 catalog_manager.cc:5697] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:53.906016  5265 tablet_bootstrap.cc:654] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.909175  5512 raft_consensus.cc:493] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.909682  5512 raft_consensus.cc:515] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.911651  5512 leader_election.cc:290] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:53.912923  5039 leader_election.cc:304] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:53.915362  5322 raft_consensus.cc:2804] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:53.918911  5322 raft_consensus.cc:697] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:53.934309  5322 consensus_queue.cc:237] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.929728  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70fcd244ec422c887a45f476de45f1" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:53.922780  5066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70fcd244ec422c887a45f476de45f1" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:53.941509  5262 ts_tablet_manager.cc:1434] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.117s	user 0.006s	sys 0.001s
I20260709 12:25:53.952773  5262 tablet_bootstrap.cc:492] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:53.957263  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d4eb4d7d548c88dc21b8bafee287e" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:53.957901  5218 raft_consensus.cc:2468] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:53.961611  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d4eb4d7d548c88dc21b8bafee287e" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:53.964336  5140 raft_consensus.cc:3060] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:53.965193  5187 leader_election.cc:343] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.968775  5265 tablet_bootstrap.cc:492] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:53.969249  5265 ts_tablet_manager.cc:1403] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.000s
I20260709 12:25:53.971817  5265 raft_consensus.cc:359] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.965636  5187 leader_election.cc:304] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:53.977624  5273 raft_consensus.cc:2749] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:53.983494  5039 leader_election.cc:304] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
W20260709 12:25:53.985183  5037 leader_election.cc:343] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.986682  5263 tablet_bootstrap.cc:492] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:53.987206  5263 ts_tablet_manager.cc:1403] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.128s	user 0.007s	sys 0.014s
I20260709 12:25:53.988747  5560 raft_consensus.cc:2804] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.989156  5560 raft_consensus.cc:493] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.989494  5560 raft_consensus.cc:3060] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.989861  5263 raft_consensus.cc:359] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.991482  5263 raft_consensus.cc:385] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.991777  5263 raft_consensus.cc:740] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.992583  5263 consensus_queue.cc:260] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.994892  5262 tablet_bootstrap.cc:654] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.005017  5560 raft_consensus.cc:515] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:53.994933  5263 ts_tablet_manager.cc:1434] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:25:54.007012  5263 tablet_bootstrap.cc:492] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:54.014328  5263 tablet_bootstrap.cc:654] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.017354  5262 tablet_bootstrap.cc:492] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:54.017941  5262 ts_tablet_manager.cc:1403] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.003s
I20260709 12:25:54.020181  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d4eb4d7d548c88dc21b8bafee287e" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:25:54.016495  5113 leader_election.cc:304] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:54.020646  5262 raft_consensus.cc:359] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.021700  5262 raft_consensus.cc:385] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.021885  5471 raft_consensus.cc:2749] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.022032  5262 raft_consensus.cc:740] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
W20260709 12:25:54.022217  5037 leader_election.cc:343] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.023268  5262 consensus_queue.cc:260] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.027400  5560 leader_election.cc:290] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:54.030341  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d4eb4d7d548c88dc21b8bafee287e" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:54.030922  5222 raft_consensus.cc:3060] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.032887  5262 ts_tablet_manager.cc:1434] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.004s
I20260709 12:25:54.034026  5262 tablet_bootstrap.cc:492] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Bootstrap starting.
I20260709 12:25:53.972496  5265 raft_consensus.cc:385] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.035493  5265 raft_consensus.cc:740] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.035009  5621 raft_consensus.cc:493] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.036685  5621 raft_consensus.cc:515] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.038763  5621 leader_election.cc:290] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:54.039119  5222 raft_consensus.cc:2468] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:54.040477  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1838a7c5a8e448ff84f311a659312dff" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
W20260709 12:25:54.041808  5037 leader_election.cc:343] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.042395  5039 leader_election.cc:304] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:54.043172  5621 raft_consensus.cc:2804] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.043758  5621 raft_consensus.cc:697] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:54.044510  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1838a7c5a8e448ff84f311a659312dff" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:54.044852  5621 consensus_queue.cc:237] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.048214  5262 tablet_bootstrap.cc:654] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.051570  5263 tablet_bootstrap.cc:492] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:54.052004  5263 ts_tablet_manager.cc:1403] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.004s
W20260709 12:25:54.059340  5039 leader_election.cc:343] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.059953  5039 leader_election.cc:304] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:54.037165  5265 consensus_queue.cc:260] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.066145  5265 ts_tablet_manager.cc:1434] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.000s
I20260709 12:25:54.067377  5265 tablet_bootstrap.cc:492] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3: Bootstrap starting.
I20260709 12:25:54.070565  5322 raft_consensus.cc:2749] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.057528  5263 raft_consensus.cc:359] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.079649  5263 raft_consensus.cc:385] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.079975  5263 raft_consensus.cc:740] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.080682  5263 consensus_queue.cc:260] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.083897  5263 ts_tablet_manager.cc:1434] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:25:54.085248  5263 tablet_bootstrap.cc:492] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:54.086748  5621 raft_consensus.cc:493] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.087507  5621 raft_consensus.cc:515] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.090081  5621 leader_election.cc:290] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:54.090721  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebf5bf87e474e0fbdecf20901b28622" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:25:54.092109  5263 tablet_bootstrap.cc:654] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:54.092171  5037 leader_election.cc:343] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.105500  5263 tablet_bootstrap.cc:492] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:54.106217  5263 ts_tablet_manager.cc:1403] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 12:25:54.109668  5263 raft_consensus.cc:359] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.110649  5263 raft_consensus.cc:385] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.110991  5263 raft_consensus.cc:740] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.112008  5263 consensus_queue.cc:260] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.117569  5263 ts_tablet_manager.cc:1434] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:25:54.118903  5263 tablet_bootstrap.cc:492] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:54.125654  5263 tablet_bootstrap.cc:654] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.127723  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebf5bf87e474e0fbdecf20901b28622" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:54.128541  5222 raft_consensus.cc:2468] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 0.
I20260709 12:25:54.171622  5621 consensus_queue.cc:1048] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.177994  5471 raft_consensus.cc:493] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.178711  5471 raft_consensus.cc:515] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.179859  5263 tablet_bootstrap.cc:492] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:54.180316  5263 ts_tablet_manager.cc:1403] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.062s	user 0.031s	sys 0.017s
I20260709 12:25:54.183068  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3a3a987e8c145f484b2c0aa9890ed20" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:54.183313  5263 raft_consensus.cc:359] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.183990  5263 raft_consensus.cc:385] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.184253  5263 raft_consensus.cc:740] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.184852  5263 consensus_queue.cc:260] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.185555  5471 leader_election.cc:290] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:54.187762  5071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3a3a987e8c145f484b2c0aa9890ed20" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:54.188849  5071 raft_consensus.cc:2393] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d22f4ab7b09f42258209170e7c9214cb in current term 1: Already voted for candidate 6e72ecbdf12a4160856b2a57422118a3 in this term.
I20260709 12:25:54.191082  5113 leader_election.cc:304] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:54.192013  5263 ts_tablet_manager.cc:1434] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.002s
I20260709 12:25:54.193005  5263 tablet_bootstrap.cc:492] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:54.197105  5471 raft_consensus.cc:3060] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:54.200771  5018 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:54.203179  5263 tablet_bootstrap.cc:654] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.212697  5322 consensus_queue.cc:1048] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.232522  5262 tablet_bootstrap.cc:492] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: No bootstrap required, opened a new log
I20260709 12:25:54.233060  5262 ts_tablet_manager.cc:1403] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent bootstrapping tablet: real 0.199s	user 0.056s	sys 0.102s
I20260709 12:25:54.234648  5265 tablet_bootstrap.cc:654] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.235746  5262 raft_consensus.cc:359] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.236467  5262 raft_consensus.cc:385] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.238569  5262 raft_consensus.cc:740] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.239789  5262 consensus_queue.cc:260] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.241567  5262 ts_tablet_manager.cc:1434] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:25:54.177172  5039 leader_election.cc:304] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:54.254722  5623 raft_consensus.cc:493] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.255296  5622 raft_consensus.cc:2804] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.255252  5623 raft_consensus.cc:515] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.255746  5622 raft_consensus.cc:493] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.257192  5622 raft_consensus.cc:3060] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.257551  5623 leader_election.cc:290] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:54.259953  5263 tablet_bootstrap.cc:492] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:54.260572  5263 ts_tablet_manager.cc:1403] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.006s
I20260709 12:25:54.263497  5622 raft_consensus.cc:515] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.263981  5263 raft_consensus.cc:359] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.264925  5263 raft_consensus.cc:385] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.265053  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f0b7d7401864a6cadec140ae4603df6" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:54.265302  5263 raft_consensus.cc:740] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.266024  5222 raft_consensus.cc:2468] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:54.266606  5263 consensus_queue.cc:260] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.267220  5114 leader_election.cc:304] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:54.268365  5646 raft_consensus.cc:2804] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.268767  5646 raft_consensus.cc:493] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.268854  5263 ts_tablet_manager.cc:1434] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:25:54.269146  5646 raft_consensus.cc:3060] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.270252  5263 tablet_bootstrap.cc:492] T c89d4eb4d7d548c88dc21b8bafee287e P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
W20260709 12:25:54.274241  5039 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 97189us
I20260709 12:25:54.276106  5621 consensus_queue.cc:1048] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.278487  5471 raft_consensus.cc:2749] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.278790  5646 raft_consensus.cc:515] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.282392  5263 tablet_bootstrap.cc:654] T c89d4eb4d7d548c88dc21b8bafee287e P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.282881  5071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f0b7d7401864a6cadec140ae4603df6" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:54.283546  5071 raft_consensus.cc:2468] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:54.289630  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebf5bf87e474e0fbdecf20901b28622" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
W20260709 12:25:54.290822  5037 leader_election.cc:343] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.293052  5622 leader_election.cc:290] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:54.300966  5071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f0b7d7401864a6cadec140ae4603df6" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:54.301555  5071 raft_consensus.cc:3060] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.302105  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f0b7d7401864a6cadec140ae4603df6" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:54.302634  5222 raft_consensus.cc:3060] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.306385  5646 leader_election.cc:290] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
W20260709 12:25:54.361202  5039 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 52735.6us
I20260709 12:25:54.364068  5222 raft_consensus.cc:2468] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:54.367823  5114 leader_election.cc:304] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:54.369154  5265 tablet_bootstrap.cc:492] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3: No bootstrap required, opened a new log
I20260709 12:25:54.369611  5265 ts_tablet_manager.cc:1403] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3: Time spent bootstrapping tablet: real 0.303s	user 0.011s	sys 0.000s
I20260709 12:25:54.369779  5267 consensus_queue.cc:1048] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:54.368433  5037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 53318.1us
I20260709 12:25:54.371459  5512 raft_consensus.cc:2804] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.373417  5512 raft_consensus.cc:697] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:25:54.374228  5512 consensus_queue.cc:237] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.383481  5631 consensus_queue.cc:1048] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:25:54.395032  5265 raft_consensus.cc:359] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.395746  5265 raft_consensus.cc:385] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.395784  5646 raft_consensus.cc:493] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.396108  5265 raft_consensus.cc:740] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.396294  5646 raft_consensus.cc:515] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.397550  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebf5bf87e474e0fbdecf20901b28622" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:54.398147  5218 raft_consensus.cc:3060] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.398379  5646 leader_election.cc:290] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:54.399385  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00dc8dae764febafe0efdc0fadcdac" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:54.402554  5071 raft_consensus.cc:2468] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:54.405639  5265 consensus_queue.cc:260] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.428314  5273 consensus_queue.cc:1048] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.429008  5265 ts_tablet_manager.cc:1434] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 12:25:54.428874  5065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00dc8dae764febafe0efdc0fadcdac" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:54.449087  5263 tablet_bootstrap.cc:492] T c89d4eb4d7d548c88dc21b8bafee287e P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:54.449610  5263 ts_tablet_manager.cc:1403] T c89d4eb4d7d548c88dc21b8bafee287e P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.180s	user 0.018s	sys 0.011s
I20260709 12:25:54.475772  5218 raft_consensus.cc:2468] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 1.
I20260709 12:25:54.476114  5263 raft_consensus.cc:359] T c89d4eb4d7d548c88dc21b8bafee287e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.476856  5263 raft_consensus.cc:385] T c89d4eb4d7d548c88dc21b8bafee287e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.477128  5263 raft_consensus.cc:740] T c89d4eb4d7d548c88dc21b8bafee287e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.477799  5263 consensus_queue.cc:260] T c89d4eb4d7d548c88dc21b8bafee287e P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.480140  5263 ts_tablet_manager.cc:1434] T c89d4eb4d7d548c88dc21b8bafee287e P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.011s
I20260709 12:25:54.483105  5263 tablet_bootstrap.cc:492] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb: Bootstrap starting.
I20260709 12:25:54.489398  5263 tablet_bootstrap.cc:654] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.516199  4971 catalog_manager.cc:5697] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 0 to 1, leader changed from <none> to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.518564  5113 leader_election.cc:304] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:54.519945  5647 raft_consensus.cc:2749] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.519918  5039 leader_election.cc:304] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:25:54.521054  5630 raft_consensus.cc:2804] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.521834  5630 raft_consensus.cc:697] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:54.522722  5630 consensus_queue.cc:237] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.532228  5623 raft_consensus.cc:493] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.532790  5623 raft_consensus.cc:515] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.533836  5143 raft_consensus.cc:3060] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.534902  5623 leader_election.cc:290] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:54.536974  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccce9c827ef54c7fa65928fda3eb7acf" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:54.537698  5222 raft_consensus.cc:2393] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d22f4ab7b09f42258209170e7c9214cb in current term 1: Already voted for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in this term.
I20260709 12:25:54.542484  5621 consensus_queue.cc:1048] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.552691  5621 consensus_queue.cc:1048] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.553081  5069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccce9c827ef54c7fa65928fda3eb7acf" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:54.561398  5113 leader_election.cc:304] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:25:54.564527  5143 raft_consensus.cc:3060] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.575150  5647 raft_consensus.cc:2749] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.623962  4968 catalog_manager.cc:5697] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.630681  4968 catalog_manager.cc:5697] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.652159  5263 tablet_bootstrap.cc:492] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb: No bootstrap required, opened a new log
I20260709 12:25:54.652050  5647 raft_consensus.cc:493] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.652698  5263 ts_tablet_manager.cc:1403] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb: Time spent bootstrapping tablet: real 0.170s	user 0.021s	sys 0.086s
I20260709 12:25:54.652644  5647 raft_consensus.cc:515] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.655309  5263 raft_consensus.cc:359] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.656006  5263 raft_consensus.cc:385] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.656286  5263 raft_consensus.cc:740] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.656435  5647 leader_election.cc:290] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:54.655567  5069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1838a7c5a8e448ff84f311a659312dff" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:54.656944  5263 consensus_queue.cc:260] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.657109  5069 raft_consensus.cc:2468] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:54.658473  5113 leader_election.cc:304] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:54.659389  5623 raft_consensus.cc:2804] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.659572  5263 ts_tablet_manager.cc:1434] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:25:54.659768  5623 raft_consensus.cc:493] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.660144  5623 raft_consensus.cc:3060] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.664145  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1838a7c5a8e448ff84f311a659312dff" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:54.664856  5219 raft_consensus.cc:2468] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 0.
I20260709 12:25:54.679760  5623 raft_consensus.cc:515] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.682597  5069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1838a7c5a8e448ff84f311a659312dff" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:54.683202  5069 raft_consensus.cc:3060] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.688714  5621 consensus_queue.cc:1048] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.690143  4971 catalog_manager.cc:5697] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.695319  5069 raft_consensus.cc:2468] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:54.696914  5113 leader_election.cc:304] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:25:54.697734  5647 raft_consensus.cc:2804] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.698751  5647 raft_consensus.cc:697] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:25:54.699662  5647 consensus_queue.cc:237] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.719115  5623 leader_election.cc:290] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:54.742707  5512 raft_consensus.cc:493] T c89d4eb4d7d548c88dc21b8bafee287e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.757361  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1838a7c5a8e448ff84f311a659312dff" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:54.758033  5221 raft_consensus.cc:3060] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.748654  5512 raft_consensus.cc:515] T c89d4eb4d7d548c88dc21b8bafee287e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:54.767674  5221 raft_consensus.cc:2468] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:54.772790  5512 leader_election.cc:290] T c89d4eb4d7d548c88dc21b8bafee287e P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:54.764616  5144 raft_consensus.cc:3060] T c89d4eb4d7d548c88dc21b8bafee287e P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.774250  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d4eb4d7d548c88dc21b8bafee287e" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:54.837221  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d4eb4d7d548c88dc21b8bafee287e" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
W20260709 12:25:54.844210  5114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 70387.8us
I20260709 12:25:54.939587  5471 consensus_queue.cc:1048] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:25:54.948346  5114 leader_election.cc:304] T c89d4eb4d7d548c88dc21b8bafee287e P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
W20260709 12:25:54.957511  5039 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 86745.3us
I20260709 12:25:54.959827  5646 raft_consensus.cc:2749] T c89d4eb4d7d548c88dc21b8bafee287e P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.997262  5634 consensus_queue.cc:1048] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.023176  5140 raft_consensus.cc:3060] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.046628  5344 consensus_queue.cc:1048] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.084944  5344 raft_consensus.cc:493] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.085403  5344 raft_consensus.cc:515] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:55.099186  5687 consensus_queue.cc:1048] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.099836  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebf5bf87e474e0fbdecf20901b28622" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:25:55.104238  5344 leader_election.cc:290] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:55.117225  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebf5bf87e474e0fbdecf20901b28622" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:25:55.118010  5219 raft_consensus.cc:2468] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 1.
I20260709 12:25:55.119163  5114 leader_election.cc:304] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:25:55.121933  5511 raft_consensus.cc:2804] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:55.122330  5511 raft_consensus.cc:493] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.122676  5511 raft_consensus.cc:3060] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.136811  5511 raft_consensus.cc:515] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:55.142140  5511 leader_election.cc:290] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:25:55.143392  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebf5bf87e474e0fbdecf20901b28622" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:25:55.143716  5069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebf5bf87e474e0fbdecf20901b28622" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:25:55.144078  5220 raft_consensus.cc:3060] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.147549  4971 catalog_manager.cc:5697] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } }
I20260709 12:25:55.154716  5220 raft_consensus.cc:2468] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 2.
I20260709 12:25:55.154789  5634 consensus_queue.cc:1048] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.156288  5114 leader_election.cc:304] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:25:55.157510  5344 raft_consensus.cc:2804] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:55.158104  5344 raft_consensus.cc:697] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:25:55.159126  5344 consensus_queue.cc:237] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:55.176321  5511 consensus_queue.cc:1048] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.180544  5140 raft_consensus.cc:1240] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Rejecting Update request from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:25:55.191707  5219 raft_consensus.cc:1240] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Rejecting Update request from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:55.191844  4969 catalog_manager.cc:5697] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.194304  5634 consensus_queue.cc:1059] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:55.195051  5634 consensus_queue.cc:1243] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Peer d22f4ab7b09f42258209170e7c9214cb log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:25:55.195590  5634 raft_consensus.cc:3055] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:55.195871  5634 raft_consensus.cc:740] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:25:55.196710  5634 consensus_queue.cc:260] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:25:55.200038  5688 consensus_queue.cc:1059] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:55.201871  5634 raft_consensus.cc:3060] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:55.594605  5219 raft_consensus.cc:1275] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:55.596084  5511 consensus_queue.cc:1048] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:55.610432  5071 raft_consensus.cc:1275] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:25:55.610869  5071 pending_rounds.cc:85] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Aborting all ops after (but not including) 0
I20260709 12:25:55.611218  5071 pending_rounds.cc:107] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:25:55.611581  5071 raft_consensus.cc:2889] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:55.616443  5471 consensus_queue.cc:1048] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:55.750437  3873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:55.782414  5698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:55.782714  5701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:55.783329  5699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:55.784821  3873 server_base.cc:1061] running on GCE node
I20260709 12:25:55.786727  3873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:55.786994  3873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:55.787235  3873 hybrid_clock.cc:648] HybridClock initialized: now 1783599955787215 us; error 0 us; skew 500 ppm
I20260709 12:25:55.787794  3873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:55.791365  3873 webserver.cc:533] Webserver started at http://127.3.200.68:36411/ using document root <none> and password file <none>
I20260709 12:25:55.792176  3873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:55.792523  3873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:55.793130  3873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:55.794852  3873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-3-root/instance:
uuid: "e030bb11bf104d5298a2521f8f7b206b"
format_stamp: "Formatted at 2026-07-09 12:25:55 on dist-test-slave-px1m"
I20260709 12:25:55.800724  3873 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 12:25:55.804950  5707 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:55.805891  3873 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:25:55.806202  3873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-3-root
uuid: "e030bb11bf104d5298a2521f8f7b206b"
format_stamp: "Formatted at 2026-07-09 12:25:55 on dist-test-slave-px1m"
I20260709 12:25:55.806497  3873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:55.824990  3873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:55.826449  3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:55.827986  3873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:55.841358  3873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:55.841738  3873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:55.842065  3873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:55.842295  3873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:55.917230  3873 rpc_server.cc:307] RPC server started. Bound to: 127.3.200.68:43655
I20260709 12:25:55.917359  5769 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.200.68:43655 every 8 connection(s)
I20260709 12:25:55.926715  3873 auto_leader_rebalancer-test.cc:439] add a tserver: e030bb11bf104d5298a2521f8f7b206b
I20260709 12:25:55.937916  5770 heartbeater.cc:344] Connected to a master server at 127.3.200.126:42719
I20260709 12:25:55.938374  5770 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:55.939285  5770 heartbeater.cc:507] Master 127.3.200.126:42719 requested a full tablet report, sending...
I20260709 12:25:55.941409  4971 ts_manager.cc:194] Registered new tserver with Master: e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:25:55.942862  4971 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33648
I20260709 12:25:56.353538  5141 consensus_queue.cc:237] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:25:56.361594  5219 raft_consensus.cc:1275] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:56.363018  5069 raft_consensus.cc:1275] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:56.363121  5774 consensus_queue.cc:1048] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:56.371380  5774 consensus_queue.cc:1048] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.377828  5687 raft_consensus.cc:2955] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
W20260709 12:25:56.386909  5112 consensus_peers.cc:597] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ea368926e6346baa3b0065d3c9c510e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:56.388455  5219 raft_consensus.cc:2955] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:56.402189  5069 raft_consensus.cc:2955] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:56.419247  5071 consensus_queue.cc:237] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:25:56.430210  4971 catalog_manager.cc:5697] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:56.443404  5219 raft_consensus.cc:1275] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:56.445013  5630 consensus_queue.cc:1048] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.462651  5147 raft_consensus.cc:1275] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:56.465514  5688 consensus_queue.cc:1048] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.464468  5634 raft_consensus.cc:2955] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:56.466411  5222 raft_consensus.cc:2955] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
W20260709 12:25:56.468612  5037 consensus_peers.cc:597] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 500a5a8d445949f0b0d635fd3820f5c9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:56.479116  5147 raft_consensus.cc:2955] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:56.504660  5069 consensus_queue.cc:237] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:25:56.512154  4968 catalog_manager.cc:5697] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:56.519941  5219 raft_consensus.cc:1275] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:56.521632  5147 raft_consensus.cc:1275] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:56.523833  5688 consensus_queue.cc:1048] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.524638  5634 consensus_queue.cc:1048] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:56.529639  5037 consensus_peers.cc:597] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b00d99b54ae4fda8d58410ef0b5c3e3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:56.538450  5634 raft_consensus.cc:2955] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:56.540460  5222 raft_consensus.cc:2955] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:56.547863  5147 raft_consensus.cc:2955] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:56.557238  5141 consensus_queue.cc:237] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:25:56.558727  4971 catalog_manager.cc:5697] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:56.575985  5071 raft_consensus.cc:1275] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:56.577443  5687 consensus_queue.cc:1048] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:56.578393  5112 consensus_peers.cc:597] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1838a7c5a8e448ff84f311a659312dff. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:56.580461  5222 raft_consensus.cc:1275] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:56.587232  5687 consensus_queue.cc:1048] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:56.588876  5782 raft_consensus.cc:2955] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:56.590915  5069 raft_consensus.cc:2955] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:56.610558  4971 catalog_manager.cc:5697] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.610865  5219 raft_consensus.cc:2955] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:56.814767  5798 ts_tablet_manager.cc:933] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:56.816803  5798 tablet_copy_client.cc:323] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.66:37067
I20260709 12:25:56.829591  5158 tablet_copy_service.cc:140] P d22f4ab7b09f42258209170e7c9214cb: Received BeginTabletCopySession request for tablet 9ea368926e6346baa3b0065d3c9c510e from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:42108)
I20260709 12:25:56.830246  5158 tablet_copy_service.cc:161] P d22f4ab7b09f42258209170e7c9214cb: Beginning new tablet copy session on tablet 9ea368926e6346baa3b0065d3c9c510e from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:42108: session id = e030bb11bf104d5298a2521f8f7b206b-9ea368926e6346baa3b0065d3c9c510e
I20260709 12:25:56.843725  5158 tablet_copy_source_session.cc:215] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:56.849825  5798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ea368926e6346baa3b0065d3c9c510e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:56.863502  5798 tablet_copy_client.cc:806] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:56.864120  5798 tablet_copy_client.cc:670] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:56.868331  5798 tablet_copy_client.cc:538] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:56.875433  5798 tablet_bootstrap.cc:492] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:25:56.895169  5798 tablet_bootstrap.cc:492] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:56.897104  5798 tablet_bootstrap.cc:492] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:25:56.897872  5798 ts_tablet_manager.cc:1403] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.023s	user 0.022s	sys 0.000s
I20260709 12:25:56.900924  5798 raft_consensus.cc:359] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:25:56.901854  5798 raft_consensus.cc:740] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:25:56.902577  5798 consensus_queue.cc:260] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:25:56.913038  5770 heartbeater.cc:499] Master 127.3.200.126:42719 was elected leader, sending a full tablet report...
I20260709 12:25:56.922320  5798 ts_tablet_manager.cc:1434] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.003s
I20260709 12:25:56.924077  5158 tablet_copy_service.cc:342] P d22f4ab7b09f42258209170e7c9214cb: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-9ea368926e6346baa3b0065d3c9c510e received from {username='slave'} at 127.0.0.1:42108
I20260709 12:25:56.924542  5158 tablet_copy_service.cc:434] P d22f4ab7b09f42258209170e7c9214cb: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-9ea368926e6346baa3b0065d3c9c510e on tablet 9ea368926e6346baa3b0065d3c9c510e with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:25:57.003999  5798 ts_tablet_manager.cc:933] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149)
I20260709 12:25:57.006217  5798 tablet_copy_client.cc:323] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.65:37149
I20260709 12:25:57.015862  5083 tablet_copy_service.cc:140] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Received BeginTabletCopySession request for tablet 500a5a8d445949f0b0d635fd3820f5c9 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:53396)
I20260709 12:25:57.016485  5083 tablet_copy_service.cc:161] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Beginning new tablet copy session on tablet 500a5a8d445949f0b0d635fd3820f5c9 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:53396: session id = e030bb11bf104d5298a2521f8f7b206b-500a5a8d445949f0b0d635fd3820f5c9
I20260709 12:25:57.022007  5083 tablet_copy_source_session.cc:215] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:57.024847  5798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 500a5a8d445949f0b0d635fd3820f5c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.043124  5798 tablet_copy_client.cc:806] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:57.043668  5798 tablet_copy_client.cc:670] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:57.048192  5798 tablet_copy_client.cc:538] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:57.056401  5798 tablet_bootstrap.cc:492] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:25:57.073262  5798 tablet_bootstrap.cc:492] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:57.074206  5798 tablet_bootstrap.cc:492] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:25:57.074856  5798 ts_tablet_manager.cc:1403] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.004s
I20260709 12:25:57.077823  5798 raft_consensus.cc:359] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:25:57.078641  5798 raft_consensus.cc:740] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:25:57.079219  5798 consensus_queue.cc:260] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:25:57.081327  5798 ts_tablet_manager.cc:1434] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:25:57.083406  5083 tablet_copy_service.cc:342] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-500a5a8d445949f0b0d635fd3820f5c9 received from {username='slave'} at 127.0.0.1:53396
I20260709 12:25:57.083887  5083 tablet_copy_service.cc:434] P 0aa78544c8fb4f9cbf5ab1a935e18e82: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-500a5a8d445949f0b0d635fd3820f5c9 on tablet 500a5a8d445949f0b0d635fd3820f5c9 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:25:57.101579  5798 ts_tablet_manager.cc:933] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149)
I20260709 12:25:57.105297  5798 tablet_copy_client.cc:323] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.65:37149
I20260709 12:25:57.107015  5083 tablet_copy_service.cc:140] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Received BeginTabletCopySession request for tablet 5b00d99b54ae4fda8d58410ef0b5c3e3 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:53396)
I20260709 12:25:57.107481  5083 tablet_copy_service.cc:161] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Beginning new tablet copy session on tablet 5b00d99b54ae4fda8d58410ef0b5c3e3 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:53396: session id = e030bb11bf104d5298a2521f8f7b206b-5b00d99b54ae4fda8d58410ef0b5c3e3
I20260709 12:25:57.113421  5083 tablet_copy_source_session.cc:215] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:57.116359  5798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b00d99b54ae4fda8d58410ef0b5c3e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.131768  5798 tablet_copy_client.cc:806] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:57.132336  5798 tablet_copy_client.cc:670] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:57.137776  5798 tablet_copy_client.cc:538] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:57.143940  5798 tablet_bootstrap.cc:492] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:25:57.165874  5798 tablet_bootstrap.cc:492] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:57.166688  5798 tablet_bootstrap.cc:492] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:25:57.167243  5798 ts_tablet_manager.cc:1403] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.004s
I20260709 12:25:57.169457  5798 raft_consensus.cc:359] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:25:57.170104  5798 raft_consensus.cc:740] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:25:57.170739  5798 consensus_queue.cc:260] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:25:57.173252  5798 ts_tablet_manager.cc:1434] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:25:57.184780  5083 tablet_copy_service.cc:342] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-5b00d99b54ae4fda8d58410ef0b5c3e3 received from {username='slave'} at 127.0.0.1:53396
I20260709 12:25:57.185364  5083 tablet_copy_service.cc:434] P 0aa78544c8fb4f9cbf5ab1a935e18e82: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-5b00d99b54ae4fda8d58410ef0b5c3e3 on tablet 5b00d99b54ae4fda8d58410ef0b5c3e3 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:25:57.188485  5798 ts_tablet_manager.cc:933] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:25:57.198975  5798 tablet_copy_client.cc:323] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.66:37067
I20260709 12:25:57.204505  5158 tablet_copy_service.cc:140] P d22f4ab7b09f42258209170e7c9214cb: Received BeginTabletCopySession request for tablet 1838a7c5a8e448ff84f311a659312dff from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:42108)
I20260709 12:25:57.205094  5158 tablet_copy_service.cc:161] P d22f4ab7b09f42258209170e7c9214cb: Beginning new tablet copy session on tablet 1838a7c5a8e448ff84f311a659312dff from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:42108: session id = e030bb11bf104d5298a2521f8f7b206b-1838a7c5a8e448ff84f311a659312dff
I20260709 12:25:57.211972  5158 tablet_copy_source_session.cc:215] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:57.214432  5798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1838a7c5a8e448ff84f311a659312dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.224164  5798 tablet_copy_client.cc:806] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:57.224691  5798 tablet_copy_client.cc:670] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:57.228597  5798 tablet_copy_client.cc:538] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:57.234148  5798 tablet_bootstrap.cc:492] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:25:57.247795  5798 tablet_bootstrap.cc:492] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:57.248464  5798 tablet_bootstrap.cc:492] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:25:57.249009  5798 ts_tablet_manager.cc:1403] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.003s
I20260709 12:25:57.251330  5798 raft_consensus.cc:359] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:25:57.251880  5798 raft_consensus.cc:740] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:25:57.252465  5798 consensus_queue.cc:260] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:25:57.254410  5798 ts_tablet_manager.cc:1434] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:57.256114  5158 tablet_copy_service.cc:342] P d22f4ab7b09f42258209170e7c9214cb: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-1838a7c5a8e448ff84f311a659312dff received from {username='slave'} at 127.0.0.1:42108
I20260709 12:25:57.256515  5158 tablet_copy_service.cc:434] P d22f4ab7b09f42258209170e7c9214cb: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-1838a7c5a8e448ff84f311a659312dff on tablet 1838a7c5a8e448ff84f311a659312dff with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:25:57.294395  5745 raft_consensus.cc:1217] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:25:57.405601  5745 raft_consensus.cc:1217] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:25:57.588524  5745 raft_consensus.cc:1217] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:25:57.630044  5745 raft_consensus.cc:1217] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:25:57.684540  5471 raft_consensus.cc:1064] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:25:57.687088  5471 consensus_queue.cc:237] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:25:57.695510  5222 raft_consensus.cc:1275] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:57.695573  5745 raft_consensus.cc:1275] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:57.697127  5782 consensus_queue.cc:1048] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:57.704499  5782 consensus_queue.cc:1048] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:57.714682  5071 raft_consensus.cc:1275] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:57.718027  5811 consensus_queue.cc:1048] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:57.732764  5811 raft_consensus.cc:2955] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:57.741410  5219 raft_consensus.cc:2955] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:57.748035  5071 raft_consensus.cc:2955] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:57.770579  5745 raft_consensus.cc:2955] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:57.772403  4971 catalog_manager.cc:5697] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:57.810828  5141 consensus_queue.cc:237] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:25:57.816658  5745 raft_consensus.cc:1275] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:57.818121  5219 raft_consensus.cc:1275] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:57.818295  5816 consensus_queue.cc:1048] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:57.819846  5816 consensus_queue.cc:1048] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:57.826865  5815 raft_consensus.cc:2955] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:57.829350  5745 raft_consensus.cc:2955] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:57.831723  5220 raft_consensus.cc:2955] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:57.839154  4956 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9ea368926e6346baa3b0065d3c9c510e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:57.851692  4970 catalog_manager.cc:5697] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:57.869305  5060 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ea368926e6346baa3b0065d3c9c510e with delete_type TABLET_DATA_TOMBSTONED (TS 0aa78544c8fb4f9cbf5ab1a935e18e82 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39330
I20260709 12:25:57.872011  5823 tablet_replica.cc:333] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:25:57.873227  5823 raft_consensus.cc:2243] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:57.874011  5823 raft_consensus.cc:2272] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:57.879473  5823 ts_tablet_manager.cc:1916] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:57.896425  5823 ts_tablet_manager.cc:1929] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:25:57.897008  5823 log.cc:1199] T 9ea368926e6346baa3b0065d3c9c510e P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root/wals/9ea368926e6346baa3b0065d3c9c510e
I20260709 12:25:57.898690  4957 catalog_manager.cc:5028] TS 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): tablet 9ea368926e6346baa3b0065d3c9c510e (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:25:57.953076  5634 raft_consensus.cc:1064] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:25:57.955389  5634 consensus_queue.cc:237] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:25:57.961715  5220 raft_consensus.cc:1275] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:57.961902  5745 raft_consensus.cc:1275] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:57.963208  5812 consensus_queue.cc:1048] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:57.965579  5630 consensus_queue.cc:1048] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:57.969614  5147 raft_consensus.cc:1275] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:57.972270  5812 consensus_queue.cc:1048] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:57.977636  5812 raft_consensus.cc:2955] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:57.987731  5745 raft_consensus.cc:2955] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:57.989985  5140 raft_consensus.cc:2955] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:57.994681  5220 raft_consensus.cc:2955] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.009294  4970 catalog_manager.cc:5697] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.022722  5634 raft_consensus.cc:1064] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:25:58.025931  5634 consensus_queue.cc:237] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:25:58.031548  5071 consensus_queue.cc:237] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:25:58.042855  5220 raft_consensus.cc:1275] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:58.042872  5745 raft_consensus.cc:1275] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:58.044569  5812 consensus_queue.cc:1048] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:58.046116  5825 consensus_queue.cc:1048] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:58.055320  5222 raft_consensus.cc:1275] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:58.058498  5744 raft_consensus.cc:2955] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.065418  5825 consensus_queue.cc:1048] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:58.067413  5140 raft_consensus.cc:1275] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:58.053310  5812 raft_consensus.cc:2955] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.075126  5745 raft_consensus.cc:1275] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:58.075875  5634 consensus_queue.cc:1048] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:25:58.080125  5634 consensus_queue.cc:1048] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:58.110153  4969 catalog_manager.cc:5697] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.134603  5222 raft_consensus.cc:2955] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.140528  5136 tablet_service.cc:1558] Processing DeleteTablet for tablet 500a5a8d445949f0b0d635fd3820f5c9 with delete_type TABLET_DATA_TOMBSTONED (TS d22f4ab7b09f42258209170e7c9214cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33554
W20260709 12:25:58.212333  5037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:43655, user_credentials={real_user=slave}} blocked reactor thread for 105958us
I20260709 12:25:58.222126  5830 raft_consensus.cc:2955] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.227316  5815 raft_consensus.cc:1064] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:25:58.230465  5815 consensus_queue.cc:237] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:25:58.232338  5147 raft_consensus.cc:2955] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.252200  5744 raft_consensus.cc:1275] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:58.252413  5836 tablet_replica.cc:333] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:25:58.256773  5836 raft_consensus.cc:2243] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:58.252774  5222 raft_consensus.cc:1275] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:58.257292  5815 consensus_queue.cc:1048] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:58.258358  5816 consensus_queue.cc:1048] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:58.256604  4969 catalog_manager.cc:5697] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.270156  5836 raft_consensus.cc:2272] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:58.275935  5219 raft_consensus.cc:2955] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.298102  5836 ts_tablet_manager.cc:1916] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:25:58.317154  5037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 48506.8us
I20260709 12:25:58.319851  5744 raft_consensus.cc:2955] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.333750  5071 raft_consensus.cc:1275] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:58.341202  4957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 500a5a8d445949f0b0d635fd3820f5c9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:58.340512  5816 raft_consensus.cc:2955] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.345019  5471 consensus_queue.cc:1048] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:58.350010  5222 raft_consensus.cc:2955] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.378798  5071 consensus_queue.cc:237] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:25:58.381811  5744 raft_consensus.cc:2955] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.404268  4970 catalog_manager.cc:5697] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.422442  5147 consensus_queue.cc:237] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:25:58.427531  5744 raft_consensus.cc:1275] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:58.429208  5816 consensus_queue.cc:1048] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:58.432714  5222 raft_consensus.cc:1275] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:25:58.433630  5039 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 50270.9us
I20260709 12:25:58.434785  5815 consensus_queue.cc:1048] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:58.442709  5071 raft_consensus.cc:2955] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.448390  5220 raft_consensus.cc:2955] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.451929  5744 raft_consensus.cc:2955] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.452725  5782 raft_consensus.cc:2955] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.461997  5836 ts_tablet_manager.cc:1929] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:25:58.466513  4956 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1838a7c5a8e448ff84f311a659312dff with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:58.469823  5836 log.cc:1199] T 500a5a8d445949f0b0d635fd3820f5c9 P d22f4ab7b09f42258209170e7c9214cb: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-1-root/wals/500a5a8d445949f0b0d635fd3820f5c9
W20260709 12:25:58.470466  5037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 87341.1us
I20260709 12:25:58.472682  4968 catalog_manager.cc:5697] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.476929  5744 raft_consensus.cc:1275] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:58.480525  5139 raft_consensus.cc:1275] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:58.483779  4956 catalog_manager.cc:5028] TS d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): tablet 500a5a8d445949f0b0d635fd3820f5c9 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:25:58.488628  5844 consensus_queue.cc:1048] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:58.497314  5845 consensus_queue.cc:1048] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:58.501726  5060 tablet_service.cc:1558] Processing DeleteTablet for tablet 1838a7c5a8e448ff84f311a659312dff with delete_type TABLET_DATA_TOMBSTONED (TS 0aa78544c8fb4f9cbf5ab1a935e18e82 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39330
I20260709 12:25:58.512873  5845 raft_consensus.cc:2955] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.514484  5847 tablet_replica.cc:333] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:25:58.521126  5847 raft_consensus.cc:2243] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:58.521831  5847 raft_consensus.cc:2272] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:58.524367  5745 raft_consensus.cc:2955] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.526914  5139 raft_consensus.cc:2955] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.527962  5847 ts_tablet_manager.cc:1916] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:58.541428  4969 catalog_manager.cc:5697] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:25:58.551961  5847 ts_tablet_manager.cc:1929] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:25:58.552472  5847 log.cc:1199] T 1838a7c5a8e448ff84f311a659312dff P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root/wals/1838a7c5a8e448ff84f311a659312dff
I20260709 12:25:58.553231  4957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5b00d99b54ae4fda8d58410ef0b5c3e3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:58.556362  5204 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b00d99b54ae4fda8d58410ef0b5c3e3 with delete_type TABLET_DATA_TOMBSTONED (TS 6e72ecbdf12a4160856b2a57422118a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37564
I20260709 12:25:58.558354  5848 tablet_replica.cc:333] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:25:58.559370  5848 raft_consensus.cc:2243] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:58.560082  5848 raft_consensus.cc:2272] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:58.561528  4957 catalog_manager.cc:5028] TS 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): tablet 1838a7c5a8e448ff84f311a659312dff (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:25:58.563625  5848 ts_tablet_manager.cc:1916] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:58.577106  5848 ts_tablet_manager.cc:1929] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:25:58.577664  5848 log.cc:1199] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 6e72ecbdf12a4160856b2a57422118a3: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-2-root/wals/5b00d99b54ae4fda8d58410ef0b5c3e3
I20260709 12:25:58.579419  4958 catalog_manager.cc:5028] TS 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): tablet 5b00d99b54ae4fda8d58410ef0b5c3e3 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:25:59.636847  5222 consensus_queue.cc:237] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:25:59.643800  5070 raft_consensus.cc:1275] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:59.645346  5139 raft_consensus.cc:1275] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:59.645529  5853 consensus_queue.cc:1048] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:59.647087  5625 consensus_queue.cc:1048] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:59.654016  5853 raft_consensus.cc:2955] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:59.655874  5070 raft_consensus.cc:2955] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
W20260709 12:25:59.660094  5186 consensus_peers.cc:597] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97e28bbe53df40bda7a921f79ae0514f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.664762  5139 raft_consensus.cc:2955] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:59.671092  4969 catalog_manager.cc:5697] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:59.765913  5139 consensus_queue.cc:237] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
W20260709 12:25:59.786000  5112 consensus_peers.cc:597] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 22b25036e425414d9ac336d8b3074769. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.788244  5220 raft_consensus.cc:1275] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:59.788703  5070 raft_consensus.cc:1275] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:59.790036  5843 consensus_queue.cc:1048] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:59.792611  5811 consensus_queue.cc:1048] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:59.798818  5849 raft_consensus.cc:2955] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:59.804765  5222 raft_consensus.cc:2955] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:59.821905  5220 consensus_queue.cc:237] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:25:59.828490  4969 catalog_manager.cc:5697] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.836251  5071 raft_consensus.cc:2955] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
W20260709 12:25:59.839617  5186 consensus_peers.cc:597] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a00dc8dae764febafe0efdc0fadcdac. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.839977  5139 raft_consensus.cc:1275] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:59.841877  5273 consensus_queue.cc:1048] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:59.844673  5069 raft_consensus.cc:1275] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:59.846710  5859 consensus_queue.cc:1048] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:59.861128  5859 raft_consensus.cc:2955] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:59.867563  5069 raft_consensus.cc:2955] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:59.869935  5139 raft_consensus.cc:2955] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:59.875716  5071 consensus_queue.cc:237] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:25:59.890918  5220 raft_consensus.cc:1275] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:25:59.892529  5037 consensus_peers.cc:597] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d91e17c8c3b4cac9a128316050ce7df. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.893303  5863 consensus_queue.cc:1048] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:59.898442  4968 catalog_manager.cc:5697] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.903383  5865 raft_consensus.cc:2955] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:59.904863  5139 raft_consensus.cc:1275] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:59.906280  5220 raft_consensus.cc:2955] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:59.914371  5860 consensus_queue.cc:1048] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:59.929754  5141 raft_consensus.cc:2955] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:25:59.935540  4971 catalog_manager.cc:5697] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:00.059968  5879 ts_tablet_manager.cc:933] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:00.077772  5879 tablet_copy_client.cc:323] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.67:43993
I20260709 12:26:00.091791  5232 tablet_copy_service.cc:140] P 6e72ecbdf12a4160856b2a57422118a3: Received BeginTabletCopySession request for tablet 97e28bbe53df40bda7a921f79ae0514f from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:34832)
I20260709 12:26:00.092461  5232 tablet_copy_service.cc:161] P 6e72ecbdf12a4160856b2a57422118a3: Beginning new tablet copy session on tablet 97e28bbe53df40bda7a921f79ae0514f from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:34832: session id = e030bb11bf104d5298a2521f8f7b206b-97e28bbe53df40bda7a921f79ae0514f
I20260709 12:26:00.101148  5232 tablet_copy_source_session.cc:215] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:00.104351  5879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e28bbe53df40bda7a921f79ae0514f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.116443  5879 tablet_copy_client.cc:806] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:00.117053  5879 tablet_copy_client.cc:670] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:00.123062  5879 tablet_copy_client.cc:538] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:00.132730  5879 tablet_bootstrap.cc:492] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:00.149617  5879 tablet_bootstrap.cc:492] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:00.150312  5879 tablet_bootstrap.cc:492] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:00.150938  5879 ts_tablet_manager.cc:1403] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:26:00.153424  5879 raft_consensus.cc:359] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:00.154078  5879 raft_consensus.cc:740] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:00.154624  5879 consensus_queue.cc:260] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:00.159482  5879 ts_tablet_manager.cc:1434] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:26:00.161077  5232 tablet_copy_service.cc:342] P 6e72ecbdf12a4160856b2a57422118a3: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-97e28bbe53df40bda7a921f79ae0514f received from {username='slave'} at 127.0.0.1:34832
I20260709 12:26:00.161489  5232 tablet_copy_service.cc:434] P 6e72ecbdf12a4160856b2a57422118a3: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-97e28bbe53df40bda7a921f79ae0514f on tablet 97e28bbe53df40bda7a921f79ae0514f with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:00.220256  5879 ts_tablet_manager.cc:933] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:00.222510  5879 tablet_copy_client.cc:323] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.66:37067
I20260709 12:26:00.224036  5158 tablet_copy_service.cc:140] P d22f4ab7b09f42258209170e7c9214cb: Received BeginTabletCopySession request for tablet 22b25036e425414d9ac336d8b3074769 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:42108)
I20260709 12:26:00.224633  5158 tablet_copy_service.cc:161] P d22f4ab7b09f42258209170e7c9214cb: Beginning new tablet copy session on tablet 22b25036e425414d9ac336d8b3074769 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:42108: session id = e030bb11bf104d5298a2521f8f7b206b-22b25036e425414d9ac336d8b3074769
I20260709 12:26:00.234468  5158 tablet_copy_source_session.cc:215] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:00.238556  5879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b25036e425414d9ac336d8b3074769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.252717  5879 tablet_copy_client.cc:806] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:00.253589  5879 tablet_copy_client.cc:670] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:00.257462  5879 tablet_copy_client.cc:538] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:00.265852  5879 tablet_bootstrap.cc:492] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:00.282226  5879 tablet_bootstrap.cc:492] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:00.283200  5879 tablet_bootstrap.cc:492] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:00.283923  5879 ts_tablet_manager.cc:1403] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.005s
I20260709 12:26:00.286923  5879 raft_consensus.cc:359] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:00.287724  5879 raft_consensus.cc:740] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:00.288378  5879 consensus_queue.cc:260] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:00.291237  5879 ts_tablet_manager.cc:1434] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:26:00.292867  5158 tablet_copy_service.cc:342] P d22f4ab7b09f42258209170e7c9214cb: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-22b25036e425414d9ac336d8b3074769 received from {username='slave'} at 127.0.0.1:42108
I20260709 12:26:00.293275  5158 tablet_copy_service.cc:434] P d22f4ab7b09f42258209170e7c9214cb: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-22b25036e425414d9ac336d8b3074769 on tablet 22b25036e425414d9ac336d8b3074769 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:00.299007  5879 ts_tablet_manager.cc:933] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149)
I20260709 12:26:00.321823  5879 tablet_copy_client.cc:323] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.65:37149
I20260709 12:26:00.323983  5083 tablet_copy_service.cc:140] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Received BeginTabletCopySession request for tablet 5d91e17c8c3b4cac9a128316050ce7df from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:53396)
I20260709 12:26:00.324600  5083 tablet_copy_service.cc:161] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Beginning new tablet copy session on tablet 5d91e17c8c3b4cac9a128316050ce7df from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:53396: session id = e030bb11bf104d5298a2521f8f7b206b-5d91e17c8c3b4cac9a128316050ce7df
I20260709 12:26:00.332743  5083 tablet_copy_source_session.cc:215] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:00.336794  5879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d91e17c8c3b4cac9a128316050ce7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.356000  5879 tablet_copy_client.cc:806] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:00.356678  5879 tablet_copy_client.cc:670] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:00.361280  5879 tablet_copy_client.cc:538] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:00.369442  5879 tablet_bootstrap.cc:492] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:00.387557  5879 tablet_bootstrap.cc:492] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:00.388371  5879 tablet_bootstrap.cc:492] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:00.389015  5879 ts_tablet_manager.cc:1403] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:26:00.391503  5879 raft_consensus.cc:359] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:00.392242  5879 raft_consensus.cc:740] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:00.392830  5879 consensus_queue.cc:260] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:00.394913  5879 ts_tablet_manager.cc:1434] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:00.396528  5083 tablet_copy_service.cc:342] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-5d91e17c8c3b4cac9a128316050ce7df received from {username='slave'} at 127.0.0.1:53396
I20260709 12:26:00.396993  5083 tablet_copy_service.cc:434] P 0aa78544c8fb4f9cbf5ab1a935e18e82: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-5d91e17c8c3b4cac9a128316050ce7df on tablet 5d91e17c8c3b4cac9a128316050ce7df with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:00.460646  5879 ts_tablet_manager.cc:933] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:00.463253  5879 tablet_copy_client.cc:323] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.67:43993
I20260709 12:26:00.464952  5232 tablet_copy_service.cc:140] P 6e72ecbdf12a4160856b2a57422118a3: Received BeginTabletCopySession request for tablet 3a00dc8dae764febafe0efdc0fadcdac from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:34832)
I20260709 12:26:00.465476  5232 tablet_copy_service.cc:161] P 6e72ecbdf12a4160856b2a57422118a3: Beginning new tablet copy session on tablet 3a00dc8dae764febafe0efdc0fadcdac from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:34832: session id = e030bb11bf104d5298a2521f8f7b206b-3a00dc8dae764febafe0efdc0fadcdac
I20260709 12:26:00.473135  5232 tablet_copy_source_session.cc:215] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:00.476640  5879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a00dc8dae764febafe0efdc0fadcdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.492264  5879 tablet_copy_client.cc:806] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:00.492817  5879 tablet_copy_client.cc:670] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:00.495977  5879 tablet_copy_client.cc:538] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:00.503672  5879 tablet_bootstrap.cc:492] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:00.523551  5879 tablet_bootstrap.cc:492] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:00.524237  5879 tablet_bootstrap.cc:492] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:00.524854  5879 ts_tablet_manager.cc:1403] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.003s
I20260709 12:26:00.527325  5879 raft_consensus.cc:359] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:00.527942  5879 raft_consensus.cc:740] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:00.528369  5879 consensus_queue.cc:260] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:00.530148  5879 ts_tablet_manager.cc:1434] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:00.531826  5232 tablet_copy_service.cc:342] P 6e72ecbdf12a4160856b2a57422118a3: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-3a00dc8dae764febafe0efdc0fadcdac received from {username='slave'} at 127.0.0.1:34832
I20260709 12:26:00.532217  5232 tablet_copy_service.cc:434] P 6e72ecbdf12a4160856b2a57422118a3: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-3a00dc8dae764febafe0efdc0fadcdac on tablet 3a00dc8dae764febafe0efdc0fadcdac with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:00.562016  5745 raft_consensus.cc:1217] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:00.687041  5745 raft_consensus.cc:1217] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:00.688061  5744 raft_consensus.cc:1217] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:00.889209  5744 raft_consensus.cc:1217] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:00.989997  5859 raft_consensus.cc:1064] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:00.991933  5859 consensus_queue.cc:237] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:00.998160  5141 raft_consensus.cc:1275] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:00.998734  5071 raft_consensus.cc:1275] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:00.999465  5744 raft_consensus.cc:1275] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:00.999593  5859 consensus_queue.cc:1048] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:01.001102  5861 consensus_queue.cc:1048] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:01.001945  5859 consensus_queue.cc:1048] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:01.038750  5859 raft_consensus.cc:2955] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.044720  5744 raft_consensus.cc:2955] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.047282  5071 raft_consensus.cc:2955] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.055725  5141 raft_consensus.cc:2955] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.058058  4970 catalog_manager.cc:5697] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.090862  5222 consensus_queue.cc:237] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:01.097224  5744 raft_consensus.cc:1275] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:01.098541  5859 consensus_queue.cc:1048] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:01.099351  5071 raft_consensus.cc:1275] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:01.100576  5859 consensus_queue.cc:1048] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:01.106004  5861 raft_consensus.cc:2955] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.107894  5071 raft_consensus.cc:2955] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.108994  5744 raft_consensus.cc:2955] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.120424  4958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 97e28bbe53df40bda7a921f79ae0514f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:01.127187  4968 catalog_manager.cc:5697] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.142372  5136 tablet_service.cc:1558] Processing DeleteTablet for tablet 97e28bbe53df40bda7a921f79ae0514f with delete_type TABLET_DATA_TOMBSTONED (TS d22f4ab7b09f42258209170e7c9214cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33554
I20260709 12:26:01.145315  5899 tablet_replica.cc:333] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:01.147159  5899 raft_consensus.cc:2243] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.149384  5899 raft_consensus.cc:2272] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.154502  5899 ts_tablet_manager.cc:1916] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:01.170288  5899 ts_tablet_manager.cc:1929] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:01.170680  5899 log.cc:1199] T 97e28bbe53df40bda7a921f79ae0514f P d22f4ab7b09f42258209170e7c9214cb: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-1-root/wals/97e28bbe53df40bda7a921f79ae0514f
I20260709 12:26:01.172299  4956 catalog_manager.cc:5028] TS d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): tablet 97e28bbe53df40bda7a921f79ae0514f (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:01.176158  5872 raft_consensus.cc:1064] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:01.178668  5872 consensus_queue.cc:237] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:01.186280  5745 raft_consensus.cc:1275] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:01.186950  5220 raft_consensus.cc:1275] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:01.187708  5872 consensus_queue.cc:1048] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:01.188650  5071 raft_consensus.cc:1275] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:01.191576  5890 consensus_queue.cc:1048] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:01.197012  5843 consensus_queue.cc:1048] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:01.213227  5843 raft_consensus.cc:2955] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.215549  5071 raft_consensus.cc:2955] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.224710  5745 raft_consensus.cc:2955] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.231856  4969 catalog_manager.cc:5697] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.264622  5222 raft_consensus.cc:2955] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.287247  5863 raft_consensus.cc:1064] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:01.287619  5148 consensus_queue.cc:237] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:01.291970  5273 raft_consensus.cc:1064] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:01.289731  5863 consensus_queue.cc:237] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:01.294276  5273 consensus_queue.cc:237] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:01.298053  5071 raft_consensus.cc:1275] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:01.299456  5904 consensus_queue.cc:1048] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:01.305540  5745 raft_consensus.cc:1275] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:01.312383  5218 raft_consensus.cc:1275] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:01.314199  5865 consensus_queue.cc:1048] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:01.316584  5905 raft_consensus.cc:2955] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.318342  5069 raft_consensus.cc:2955] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.320781  5904 consensus_queue.cc:1048] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:01.323700  5745 raft_consensus.cc:1275] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:01.326102  5071 raft_consensus.cc:1275] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:01.326325  5273 consensus_queue.cc:1048] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:01.327437  5859 consensus_queue.cc:1048] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:01.331403  5141 raft_consensus.cc:1275] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:01.337677  5743 raft_consensus.cc:2955] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.351476  5273 consensus_queue.cc:1048] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:01.352613  4971 catalog_manager.cc:5697] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.372153  5141 raft_consensus.cc:1275] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:01.373026  5204 tablet_service.cc:1558] Processing DeleteTablet for tablet 22b25036e425414d9ac336d8b3074769 with delete_type TABLET_DATA_TOMBSTONED (TS 6e72ecbdf12a4160856b2a57422118a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37564
I20260709 12:26:01.379647  5744 raft_consensus.cc:1275] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:01.381114  5909 consensus_queue.cc:1048] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:01.382941  4956 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 22b25036e425414d9ac336d8b3074769 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:01.386023  5859 raft_consensus.cc:2955] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.388900  5745 raft_consensus.cc:2955] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.391743  5914 tablet_replica.cc:333] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:01.402410  5860 consensus_queue.cc:1048] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:01.404745  4969 catalog_manager.cc:5697] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.428388  5865 raft_consensus.cc:2955] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.429369  5744 raft_consensus.cc:2955] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.450296  5914 raft_consensus.cc:2243] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.450989  5914 raft_consensus.cc:2272] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.451059  5071 raft_consensus.cc:2955] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.454450  5914 ts_tablet_manager.cc:1916] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:01.461843  4971 catalog_manager.cc:5697] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.479139  5147 raft_consensus.cc:2955] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.484586  5222 consensus_queue.cc:237] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:01.485245  5218 raft_consensus.cc:2955] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.491864  5744 raft_consensus.cc:1275] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:01.498158  5071 raft_consensus.cc:1275] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:01.504073  5861 consensus_queue.cc:1048] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:01.507437  5918 consensus_queue.cc:1048] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:01.508199  5914 ts_tablet_manager.cc:1929] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:01.508656  5914 log.cc:1199] T 22b25036e425414d9ac336d8b3074769 P 6e72ecbdf12a4160856b2a57422118a3: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-2-root/wals/22b25036e425414d9ac336d8b3074769
I20260709 12:26:01.510277  4958 catalog_manager.cc:5028] TS 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): tablet 22b25036e425414d9ac336d8b3074769 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:01.518988  5918 raft_consensus.cc:2955] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.526108  5065 consensus_queue.cc:237] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:01.529026  5744 raft_consensus.cc:2955] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.534600  5147 raft_consensus.cc:2955] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.531953  5071 raft_consensus.cc:2955] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.537031  5743 raft_consensus.cc:1275] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:01.538698  5919 consensus_queue.cc:1048] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:01.546803  5920 raft_consensus.cc:2955] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.563941  4958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3a00dc8dae764febafe0efdc0fadcdac with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:01.571903  5148 raft_consensus.cc:1275] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:01.571692  4968 catalog_manager.cc:5697] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.575495  5744 raft_consensus.cc:2955] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.585321  5865 consensus_queue.cc:1048] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:01.590392  5148 raft_consensus.cc:2955] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:01.590423  4957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5d91e17c8c3b4cac9a128316050ce7df with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:01.594311  5136 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a00dc8dae764febafe0efdc0fadcdac with delete_type TABLET_DATA_TOMBSTONED (TS d22f4ab7b09f42258209170e7c9214cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33554
I20260709 12:26:01.595274  5899 tablet_replica.cc:333] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:01.596455  5899 raft_consensus.cc:2243] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.597298  5899 raft_consensus.cc:2272] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.601609  5899 ts_tablet_manager.cc:1916] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:01.611339  4970 catalog_manager.cc:5697] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.624195  5899 ts_tablet_manager.cc:1929] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:01.624711  5899 log.cc:1199] T 3a00dc8dae764febafe0efdc0fadcdac P d22f4ab7b09f42258209170e7c9214cb: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-1-root/wals/3a00dc8dae764febafe0efdc0fadcdac
I20260709 12:26:01.626343  4956 catalog_manager.cc:5028] TS d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): tablet 3a00dc8dae764febafe0efdc0fadcdac (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:01.630307  5204 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d91e17c8c3b4cac9a128316050ce7df with delete_type TABLET_DATA_TOMBSTONED (TS 6e72ecbdf12a4160856b2a57422118a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37564
I20260709 12:26:01.631309  5914 tablet_replica.cc:333] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:01.632266  5914 raft_consensus.cc:2243] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.632905  5914 raft_consensus.cc:2272] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.636682  5914 ts_tablet_manager.cc:1916] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:01.652989  5914 ts_tablet_manager.cc:1929] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:01.653334  5914 log.cc:1199] T 5d91e17c8c3b4cac9a128316050ce7df P 6e72ecbdf12a4160856b2a57422118a3: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-2-root/wals/5d91e17c8c3b4cac9a128316050ce7df
I20260709 12:26:01.654635  4958 catalog_manager.cc:5028] TS 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): tablet 5d91e17c8c3b4cac9a128316050ce7df (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:02.697505  5218 consensus_queue.cc:237] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:02.703876  5065 raft_consensus.cc:1275] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:02.703866  5147 raft_consensus.cc:1275] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:02.704102  5186 consensus_peers.cc:597] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4799f16941ac411c958d31adc8dbd44a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:02.705420  5859 consensus_queue.cc:1048] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:02.706187  5918 consensus_queue.cc:1048] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:02.714483  5859 raft_consensus.cc:2955] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:02.716368  5071 raft_consensus.cc:2955] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:02.727223  5147 raft_consensus.cc:2955] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:02.731021  5071 consensus_queue.cc:237] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:02.732244  4968 catalog_manager.cc:5697] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.743319  5218 raft_consensus.cc:1275] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:02.743969  5148 raft_consensus.cc:1275] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:02.744529  5919 consensus_queue.cc:1048] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:02.747458  5037 consensus_peers.cc:597] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b10627fec43d464e94516d46e5afc694. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:02.748044  5865 consensus_queue.cc:1048] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:02.762385  5865 raft_consensus.cc:2955] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:02.768422  5218 raft_consensus.cc:2955] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:02.772236  5147 raft_consensus.cc:2955] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:02.786705  5147 consensus_queue.cc:237] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:02.788713  4969 catalog_manager.cc:5697] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:02.794342  5218 raft_consensus.cc:1275] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:02.796175  5112 consensus_peers.cc:597] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ebf5bf87e474e0fbdecf20901b28622. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:02.796423  5071 raft_consensus.cc:1275] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:02.797168  5890 consensus_queue.cc:1048] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:02.798041  5905 consensus_queue.cc:1048] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:02.807554  5890 raft_consensus.cc:2955] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:02.824913  5071 raft_consensus.cc:2955] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:02.832693  5218 raft_consensus.cc:2955] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:02.838927  5147 consensus_queue.cc:237] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:02.845496  5222 raft_consensus.cc:1275] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:02.846307  5112 consensus_peers.cc:597] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04afa18a0a324c0d9788a17d1182585b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:02.845378  4971 catalog_manager.cc:5697] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.848441  5936 consensus_queue.cc:1048] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:02.852571  5065 raft_consensus.cc:1275] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:02.856449  5890 consensus_queue.cc:1048] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:02.877679  5905 raft_consensus.cc:2955] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:02.884857  5220 raft_consensus.cc:2955] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:02.890151  5065 raft_consensus.cc:2955] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:02.905725  4971 catalog_manager.cc:5697] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.130906  5940 ts_tablet_manager.cc:933] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149)
I20260709 12:26:03.132805  5940 tablet_copy_client.cc:323] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.65:37149
I20260709 12:26:03.134407  5083 tablet_copy_service.cc:140] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Received BeginTabletCopySession request for tablet b10627fec43d464e94516d46e5afc694 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:53396)
I20260709 12:26:03.134960  5083 tablet_copy_service.cc:161] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Beginning new tablet copy session on tablet b10627fec43d464e94516d46e5afc694 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:53396: session id = e030bb11bf104d5298a2521f8f7b206b-b10627fec43d464e94516d46e5afc694
I20260709 12:26:03.142629  5083 tablet_copy_source_session.cc:215] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:03.146835  5940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10627fec43d464e94516d46e5afc694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.158346  5940 tablet_copy_client.cc:806] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:03.158931  5940 tablet_copy_client.cc:670] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:03.163239  5940 tablet_copy_client.cc:538] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:03.173435  5940 tablet_bootstrap.cc:492] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:03.179896  5942 ts_tablet_manager.cc:933] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:03.188331  5942 tablet_copy_client.cc:323] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.67:43993
I20260709 12:26:03.190245  5232 tablet_copy_service.cc:140] P 6e72ecbdf12a4160856b2a57422118a3: Received BeginTabletCopySession request for tablet 4799f16941ac411c958d31adc8dbd44a from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:34832)
I20260709 12:26:03.190919  5232 tablet_copy_service.cc:161] P 6e72ecbdf12a4160856b2a57422118a3: Beginning new tablet copy session on tablet 4799f16941ac411c958d31adc8dbd44a from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:34832: session id = e030bb11bf104d5298a2521f8f7b206b-4799f16941ac411c958d31adc8dbd44a
I20260709 12:26:03.200610  5232 tablet_copy_source_session.cc:215] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:03.201785  5940 tablet_bootstrap.cc:492] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:03.202765  5940 tablet_bootstrap.cc:492] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:03.203881  5940 ts_tablet_manager.cc:1403] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.009s
I20260709 12:26:03.204006  5942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4799f16941ac411c958d31adc8dbd44a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.206959  5940 raft_consensus.cc:359] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:03.207798  5940 raft_consensus.cc:740] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:03.208441  5940 consensus_queue.cc:260] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:03.216866  5940 ts_tablet_manager.cc:1434] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.004s
I20260709 12:26:03.220196  5942 tablet_copy_client.cc:806] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:03.220752  5083 tablet_copy_service.cc:342] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-b10627fec43d464e94516d46e5afc694 received from {username='slave'} at 127.0.0.1:53396
I20260709 12:26:03.221236  5083 tablet_copy_service.cc:434] P 0aa78544c8fb4f9cbf5ab1a935e18e82: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-b10627fec43d464e94516d46e5afc694 on tablet b10627fec43d464e94516d46e5afc694 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:03.220806  5942 tablet_copy_client.cc:670] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:03.233076  5942 tablet_copy_client.cc:538] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:03.243202  5942 tablet_bootstrap.cc:492] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:03.246971  5940 ts_tablet_manager.cc:933] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:03.249070  5940 tablet_copy_client.cc:323] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.66:37067
I20260709 12:26:03.250636  5158 tablet_copy_service.cc:140] P d22f4ab7b09f42258209170e7c9214cb: Received BeginTabletCopySession request for tablet 04afa18a0a324c0d9788a17d1182585b from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:42108)
I20260709 12:26:03.251175  5158 tablet_copy_service.cc:161] P d22f4ab7b09f42258209170e7c9214cb: Beginning new tablet copy session on tablet 04afa18a0a324c0d9788a17d1182585b from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:42108: session id = e030bb11bf104d5298a2521f8f7b206b-04afa18a0a324c0d9788a17d1182585b
I20260709 12:26:03.256104  5158 tablet_copy_source_session.cc:215] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:03.259796  5940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04afa18a0a324c0d9788a17d1182585b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.270077  5942 tablet_bootstrap.cc:492] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:03.271023  5942 tablet_bootstrap.cc:492] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:03.271631  5942 ts_tablet_manager.cc:1403] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.004s
I20260709 12:26:03.274250  5942 raft_consensus.cc:359] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:03.274912  5942 raft_consensus.cc:740] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:03.275455  5942 consensus_queue.cc:260] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:03.276196  5940 tablet_copy_client.cc:806] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:03.276829  5940 tablet_copy_client.cc:670] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:03.277982  5942 ts_tablet_manager.cc:1434] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:26:03.279964  5232 tablet_copy_service.cc:342] P 6e72ecbdf12a4160856b2a57422118a3: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-4799f16941ac411c958d31adc8dbd44a received from {username='slave'} at 127.0.0.1:34832
I20260709 12:26:03.280385  5232 tablet_copy_service.cc:434] P 6e72ecbdf12a4160856b2a57422118a3: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-4799f16941ac411c958d31adc8dbd44a on tablet 4799f16941ac411c958d31adc8dbd44a with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:03.284039  5940 tablet_copy_client.cc:538] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:03.294682  5940 tablet_bootstrap.cc:492] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:03.319604  5940 tablet_bootstrap.cc:492] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:03.320580  5940 tablet_bootstrap.cc:492] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:03.321280  5940 ts_tablet_manager.cc:1403] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.012s
I20260709 12:26:03.326156  5940 raft_consensus.cc:359] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:03.326776  5940 raft_consensus.cc:740] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:03.327309  5940 consensus_queue.cc:260] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:03.329407  5940 ts_tablet_manager.cc:1434] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:03.331106  5158 tablet_copy_service.cc:342] P d22f4ab7b09f42258209170e7c9214cb: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-04afa18a0a324c0d9788a17d1182585b received from {username='slave'} at 127.0.0.1:42108
I20260709 12:26:03.331544  5158 tablet_copy_service.cc:434] P d22f4ab7b09f42258209170e7c9214cb: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-04afa18a0a324c0d9788a17d1182585b on tablet 04afa18a0a324c0d9788a17d1182585b with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:03.396080  5940 ts_tablet_manager.cc:933] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:03.398032  5940 tablet_copy_client.cc:323] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.66:37067
I20260709 12:26:03.399683  5158 tablet_copy_service.cc:140] P d22f4ab7b09f42258209170e7c9214cb: Received BeginTabletCopySession request for tablet 2ebf5bf87e474e0fbdecf20901b28622 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:42108)
I20260709 12:26:03.400246  5158 tablet_copy_service.cc:161] P d22f4ab7b09f42258209170e7c9214cb: Beginning new tablet copy session on tablet 2ebf5bf87e474e0fbdecf20901b28622 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:42108: session id = e030bb11bf104d5298a2521f8f7b206b-2ebf5bf87e474e0fbdecf20901b28622
I20260709 12:26:03.410468  5158 tablet_copy_source_session.cc:215] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:03.415302  5940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebf5bf87e474e0fbdecf20901b28622. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.432413  5940 tablet_copy_client.cc:806] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:03.433133  5940 tablet_copy_client.cc:670] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:03.437302  5940 tablet_copy_client.cc:538] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:03.444658  5940 tablet_bootstrap.cc:492] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:03.463256  5940 tablet_bootstrap.cc:492] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:03.464084  5940 tablet_bootstrap.cc:492] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:03.464651  5940 ts_tablet_manager.cc:1403] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.004s
I20260709 12:26:03.466511  5940 raft_consensus.cc:359] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:03.467216  5940 raft_consensus.cc:740] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:03.467761  5940 consensus_queue.cc:260] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:03.469759  5940 ts_tablet_manager.cc:1434] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:26:03.475294  5158 tablet_copy_service.cc:342] P d22f4ab7b09f42258209170e7c9214cb: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-2ebf5bf87e474e0fbdecf20901b28622 received from {username='slave'} at 127.0.0.1:42108
I20260709 12:26:03.475750  5158 tablet_copy_service.cc:434] P d22f4ab7b09f42258209170e7c9214cb: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-2ebf5bf87e474e0fbdecf20901b28622 on tablet 2ebf5bf87e474e0fbdecf20901b28622 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:03.664245  5744 raft_consensus.cc:1217] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:03.695263  5744 raft_consensus.cc:1217] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:03.738106  5744 raft_consensus.cc:1217] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:03.934737  5744 raft_consensus.cc:1217] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:26:04.110947  5952 raft_consensus.cc:1064] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:04.113616  5952 consensus_queue.cc:237] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:04.122932  5147 raft_consensus.cc:1275] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:04.122946  5744 raft_consensus.cc:1275] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:04.124689  5952 consensus_queue.cc:1048] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:04.126446  5951 consensus_queue.cc:1048] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:04.129045  5065 raft_consensus.cc:1275] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:04.131903  5952 consensus_queue.cc:1048] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:04.161902  5951 raft_consensus.cc:2955] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.165885  5744 raft_consensus.cc:2955] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.170068  5147 raft_consensus.cc:2955] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.184435  4968 catalog_manager.cc:5697] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.193637  5935 raft_consensus.cc:1064] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:04.196293  5935 consensus_queue.cc:237] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:04.207763  5065 raft_consensus.cc:2955] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.219738  5219 raft_consensus.cc:1275] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:04.220214  5065 raft_consensus.cc:1275] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:04.221366  5954 consensus_queue.cc:1048] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:04.222180  5744 raft_consensus.cc:1275] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:04.223253  5954 consensus_queue.cc:1048] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:04.228021  5919 raft_consensus.cc:1064] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:04.227815  5890 consensus_queue.cc:1048] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:04.230690  5919 consensus_queue.cc:237] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:04.253099  5954 raft_consensus.cc:2955] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.254195  5744 raft_consensus.cc:2955] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.267829  5219 raft_consensus.cc:2955] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.285442  5065 raft_consensus.cc:2955] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.295586  5218 consensus_queue.cc:237] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:04.300586  4968 catalog_manager.cc:5697] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.308952  5743 raft_consensus.cc:1275] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:04.311096  5859 consensus_queue.cc:1048] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:04.311621  5148 raft_consensus.cc:1275] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:04.312052  5218 raft_consensus.cc:1275] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:04.313578  5920 consensus_queue.cc:1048] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:04.318804  5743 raft_consensus.cc:1275] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:04.318847  5951 consensus_queue.cc:1048] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:04.326189  5147 raft_consensus.cc:1275] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:04.320590  5744 raft_consensus.cc:2955] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.326638  5865 consensus_queue.cc:1048] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:04.327298  5859 raft_consensus.cc:2955] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.324246  5148 consensus_queue.cc:237] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:04.334218  5865 consensus_queue.cc:1048] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:04.334561  5147 raft_consensus.cc:2955] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.340018  4958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4799f16941ac411c958d31adc8dbd44a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:04.346570  5065 raft_consensus.cc:1275] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:04.346570  5743 raft_consensus.cc:1275] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:04.348037  5935 consensus_queue.cc:1048] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:04.351899  5935 consensus_queue.cc:1048] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:04.358306  5890 raft_consensus.cc:2955] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.358695  5920 raft_consensus.cc:2955] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.360237  5071 raft_consensus.cc:2955] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.365264  5742 raft_consensus.cc:2955] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.366922  4956 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 04afa18a0a324c0d9788a17d1182585b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:04.381476  5743 raft_consensus.cc:2955] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.381762  4970 catalog_manager.cc:5697] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.394069  5060 tablet_service.cc:1558] Processing DeleteTablet for tablet 4799f16941ac411c958d31adc8dbd44a with delete_type TABLET_DATA_TOMBSTONED (TS 0aa78544c8fb4f9cbf5ab1a935e18e82 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39330
I20260709 12:26:04.405498  4970 catalog_manager.cc:5697] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:04.422017  4971 catalog_manager.cc:5697] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.423190  5220 raft_consensus.cc:2955] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.426776  5974 tablet_replica.cc:333] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:04.434624  5147 raft_consensus.cc:2955] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.445499  5071 consensus_queue.cc:237] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:04.452243  5905 raft_consensus.cc:1064] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:04.454840  5905 consensus_queue.cc:237] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:04.463032  5218 raft_consensus.cc:1275] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:04.458773  5743 raft_consensus.cc:1275] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:04.461326  5974 raft_consensus.cc:2243] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.466295  5974 raft_consensus.cc:2272] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.466558  5970 consensus_queue.cc:1048] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:04.462226  5204 tablet_service.cc:1558] Processing DeleteTablet for tablet 04afa18a0a324c0d9788a17d1182585b with delete_type TABLET_DATA_TOMBSTONED (TS 6e72ecbdf12a4160856b2a57422118a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37564
I20260709 12:26:04.470312  5974 ts_tablet_manager.cc:1916] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:04.475495  5919 consensus_queue.cc:1048] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:04.490406  5970 raft_consensus.cc:2955] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.497334  5742 raft_consensus.cc:2955] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.507373  5220 raft_consensus.cc:2955] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.517283  5975 tablet_replica.cc:333] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:04.524971  5975 raft_consensus.cc:2243] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.531136  5975 raft_consensus.cc:2272] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.537674  5974 ts_tablet_manager.cc:1929] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:04.539263  5974 log.cc:1199] T 4799f16941ac411c958d31adc8dbd44a P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root/wals/4799f16941ac411c958d31adc8dbd44a
I20260709 12:26:04.544929  5220 raft_consensus.cc:1275] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:04.545699  5975 ts_tablet_manager.cc:1916] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:04.547004  5071 raft_consensus.cc:1275] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:04.546393  4957 catalog_manager.cc:5028] TS 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): tablet 4799f16941ac411c958d31adc8dbd44a (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:04.548667  5742 raft_consensus.cc:1275] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:04.548113  4971 catalog_manager.cc:5697] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.546464  5905 consensus_queue.cc:1048] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:26:04.551826  5890 consensus_queue.cc:1048] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:04.553776  5954 consensus_queue.cc:1048] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:04.566399  5136 tablet_service.cc:1558] Processing DeleteTablet for tablet b10627fec43d464e94516d46e5afc694 with delete_type TABLET_DATA_TOMBSTONED (TS d22f4ab7b09f42258209170e7c9214cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33554
I20260709 12:26:04.578629  5905 raft_consensus.cc:2955] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.583905  5742 raft_consensus.cc:2955] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.586517  4957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b10627fec43d464e94516d46e5afc694 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:04.592279  5219 raft_consensus.cc:2955] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.596140  5979 tablet_replica.cc:333] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:04.597302  5979 raft_consensus.cc:2243] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.613679  5979 raft_consensus.cc:2272] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.603444  4971 catalog_manager.cc:5697] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.605566  5071 raft_consensus.cc:2955] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.602662  5975 ts_tablet_manager.cc:1929] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:04.618604  5975 log.cc:1199] T 04afa18a0a324c0d9788a17d1182585b P 6e72ecbdf12a4160856b2a57422118a3: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-2-root/wals/04afa18a0a324c0d9788a17d1182585b
I20260709 12:26:04.620268  4958 catalog_manager.cc:5028] TS 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): tablet 04afa18a0a324c0d9788a17d1182585b (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:04.631153  5979 ts_tablet_manager.cc:1916] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:04.633553  5147 consensus_queue.cc:237] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:04.647176  5979 ts_tablet_manager.cc:1929] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:04.647749  5979 log.cc:1199] T b10627fec43d464e94516d46e5afc694 P d22f4ab7b09f42258209170e7c9214cb: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-1-root/wals/b10627fec43d464e94516d46e5afc694
I20260709 12:26:04.649611  4956 catalog_manager.cc:5028] TS d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): tablet b10627fec43d464e94516d46e5afc694 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:04.653343  5742 raft_consensus.cc:1275] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:04.657130  5905 consensus_queue.cc:1048] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:04.657543  5219 raft_consensus.cc:1275] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:04.659037  5905 consensus_queue.cc:1048] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:04.663789  5954 raft_consensus.cc:2955] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.667316  5219 raft_consensus.cc:2955] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.673203  4956 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2ebf5bf87e474e0fbdecf20901b28622 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:04.679687  5742 raft_consensus.cc:2955] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:04.687003  4969 catalog_manager.cc:5697] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:04.699558  5060 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ebf5bf87e474e0fbdecf20901b28622 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa78544c8fb4f9cbf5ab1a935e18e82 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39330
I20260709 12:26:04.700408  5974 tablet_replica.cc:333] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:04.701228  5974 raft_consensus.cc:2243] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.701951  5974 raft_consensus.cc:2272] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.704367  5974 ts_tablet_manager.cc:1916] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:04.723755  5974 ts_tablet_manager.cc:1929] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:26:04.724090  5974 log.cc:1199] T 2ebf5bf87e474e0fbdecf20901b28622 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root/wals/2ebf5bf87e474e0fbdecf20901b28622
I20260709 12:26:04.725528  4957 catalog_manager.cc:5028] TS 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): tablet 2ebf5bf87e474e0fbdecf20901b28622 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:05.779481  5148 consensus_queue.cc:237] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:05.786343  5218 raft_consensus.cc:1275] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:05.786587  5070 raft_consensus.cc:1275] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:05.786463  5112 consensus_peers.cc:597] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04f60339b6c34e54bbf6e9b4a4c1e54e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:05.788286  5890 consensus_queue.cc:1048] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:05.789254  5935 consensus_queue.cc:1048] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:05.799309  5890 raft_consensus.cc:2955] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:05.803051  5218 raft_consensus.cc:2955] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:05.811417  5070 raft_consensus.cc:2955] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
W20260709 12:26:05.816803  5859 consensus_queue.cc:1175] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:26:05.818357  5222 consensus_queue.cc:237] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:05.818394  4971 catalog_manager.cc:5697] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.833191  5148 raft_consensus.cc:1275] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:05.835170  5186 consensus_peers.cc:597] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 47ebaac790104c1b849ecbeadadc2ac6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:05.835724  5859 consensus_queue.cc:1048] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:05.836349  5070 raft_consensus.cc:1275] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:05.843266  5859 consensus_queue.cc:1048] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:05.865741  5148 raft_consensus.cc:2955] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:05.865314  5951 raft_consensus.cc:2955] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:05.890478  5070 consensus_queue.cc:237] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:05.903492  4970 catalog_manager.cc:5697] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:05.905970  5187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 43908.5us
I20260709 12:26:05.910256  5065 raft_consensus.cc:2955] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:05.929383  5222 raft_consensus.cc:1275] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:05.931011  5920 consensus_queue.cc:1048] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:05.932017  5037 consensus_peers.cc:597] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 034ac3e487504f54ac6e50430a0b22d7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:05.936053  5148 raft_consensus.cc:1275] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:05.937682  5970 consensus_queue.cc:1048] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:05.950706  5972 raft_consensus.cc:2955] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:05.954975  5148 raft_consensus.cc:2955] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:05.956284  5219 raft_consensus.cc:2955] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:05.972307  4970 catalog_manager.cc:5697] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.971190  5219 consensus_queue.cc:237] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:05.991052  5139 raft_consensus.cc:1275] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:05.991308  5186 consensus_peers.cc:597] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3892e26d8f94adabf8bd2581fee782b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:05.991551  5070 raft_consensus.cc:1275] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:05.992585  5951 consensus_queue.cc:1048] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:05.993983  5859 consensus_queue.cc:1048] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:26:06.015767  5994 raft_consensus.cc:2955] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:06.018347  5139 raft_consensus.cc:2955] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:06.023476  5065 raft_consensus.cc:2955] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:06.038599  4971 catalog_manager.cc:5697] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.220469  6001 ts_tablet_manager.cc:933] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:06.226788  6001 tablet_copy_client.cc:323] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.66:37067
I20260709 12:26:06.229039  5158 tablet_copy_service.cc:140] P d22f4ab7b09f42258209170e7c9214cb: Received BeginTabletCopySession request for tablet 04f60339b6c34e54bbf6e9b4a4c1e54e from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:42108)
I20260709 12:26:06.229780  5158 tablet_copy_service.cc:161] P d22f4ab7b09f42258209170e7c9214cb: Beginning new tablet copy session on tablet 04f60339b6c34e54bbf6e9b4a4c1e54e from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:42108: session id = e030bb11bf104d5298a2521f8f7b206b-04f60339b6c34e54bbf6e9b4a4c1e54e
I20260709 12:26:06.239382  5158 tablet_copy_source_session.cc:215] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:06.244632  6001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f60339b6c34e54bbf6e9b4a4c1e54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:06.261477  6001 tablet_copy_client.cc:806] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:06.262120  6001 tablet_copy_client.cc:670] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:06.267328  6001 tablet_copy_client.cc:538] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:06.277194  6001 tablet_bootstrap.cc:492] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:06.280875  6003 ts_tablet_manager.cc:933] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:06.284108  6003 tablet_copy_client.cc:323] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.67:43993
I20260709 12:26:06.288988  5232 tablet_copy_service.cc:140] P 6e72ecbdf12a4160856b2a57422118a3: Received BeginTabletCopySession request for tablet 47ebaac790104c1b849ecbeadadc2ac6 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:34832)
I20260709 12:26:06.289562  5232 tablet_copy_service.cc:161] P 6e72ecbdf12a4160856b2a57422118a3: Beginning new tablet copy session on tablet 47ebaac790104c1b849ecbeadadc2ac6 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:34832: session id = e030bb11bf104d5298a2521f8f7b206b-47ebaac790104c1b849ecbeadadc2ac6
I20260709 12:26:06.297816  5232 tablet_copy_source_session.cc:215] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:06.301312  6003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ebaac790104c1b849ecbeadadc2ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:06.301880  6001 tablet_bootstrap.cc:492] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:06.302758  6001 tablet_bootstrap.cc:492] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:06.303403  6001 ts_tablet_manager.cc:1403] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.012s
I20260709 12:26:06.306705  6001 raft_consensus.cc:359] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:06.307595  6001 raft_consensus.cc:740] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:06.308468  6001 consensus_queue.cc:260] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:06.324115  6003 tablet_copy_client.cc:806] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:06.324892  6003 tablet_copy_client.cc:670] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:06.335081  6007 ts_tablet_manager.cc:933] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149)
I20260709 12:26:06.335814  6003 tablet_copy_client.cc:538] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:06.337167  6001 ts_tablet_manager.cc:1434] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.021s
I20260709 12:26:06.342211  5158 tablet_copy_service.cc:342] P d22f4ab7b09f42258209170e7c9214cb: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-04f60339b6c34e54bbf6e9b4a4c1e54e received from {username='slave'} at 127.0.0.1:42108
I20260709 12:26:06.342689  5158 tablet_copy_service.cc:434] P d22f4ab7b09f42258209170e7c9214cb: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-04f60339b6c34e54bbf6e9b4a4c1e54e on tablet 04f60339b6c34e54bbf6e9b4a4c1e54e with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:06.350508  6003 tablet_bootstrap.cc:492] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:06.358307  6007 tablet_copy_client.cc:323] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.65:37149
I20260709 12:26:06.360675  5083 tablet_copy_service.cc:140] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Received BeginTabletCopySession request for tablet 034ac3e487504f54ac6e50430a0b22d7 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:53396)
I20260709 12:26:06.361241  5083 tablet_copy_service.cc:161] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Beginning new tablet copy session on tablet 034ac3e487504f54ac6e50430a0b22d7 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:53396: session id = e030bb11bf104d5298a2521f8f7b206b-034ac3e487504f54ac6e50430a0b22d7
I20260709 12:26:06.370877  5083 tablet_copy_source_session.cc:215] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:06.382309  6007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 034ac3e487504f54ac6e50430a0b22d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:06.422508  6003 tablet_bootstrap.cc:492] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:06.423480  6003 tablet_bootstrap.cc:492] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:06.424147  6003 ts_tablet_manager.cc:1403] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.074s	user 0.038s	sys 0.023s
I20260709 12:26:06.425539  6007 tablet_copy_client.cc:806] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:06.426128  6007 tablet_copy_client.cc:670] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:06.427198  6003 raft_consensus.cc:359] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:06.429108  6003 raft_consensus.cc:740] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:06.429934  6003 consensus_queue.cc:260] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:06.432425  6003 ts_tablet_manager.cc:1434] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:26:06.433229  6007 tablet_copy_client.cc:538] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:06.434178  5232 tablet_copy_service.cc:342] P 6e72ecbdf12a4160856b2a57422118a3: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-47ebaac790104c1b849ecbeadadc2ac6 received from {username='slave'} at 127.0.0.1:34832
I20260709 12:26:06.434619  5232 tablet_copy_service.cc:434] P 6e72ecbdf12a4160856b2a57422118a3: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-47ebaac790104c1b849ecbeadadc2ac6 on tablet 47ebaac790104c1b849ecbeadadc2ac6 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:06.442747  6007 tablet_bootstrap.cc:492] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:06.459666  6007 tablet_bootstrap.cc:492] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:06.460322  6007 tablet_bootstrap.cc:492] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:06.460878  6007 ts_tablet_manager.cc:1403] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.004s
I20260709 12:26:06.463488  6007 raft_consensus.cc:359] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:06.464270  6007 raft_consensus.cc:740] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:06.465061  6007 consensus_queue.cc:260] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:06.467190  6007 ts_tablet_manager.cc:1434] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:06.468959  5083 tablet_copy_service.cc:342] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-034ac3e487504f54ac6e50430a0b22d7 received from {username='slave'} at 127.0.0.1:53396
I20260709 12:26:06.469372  5083 tablet_copy_service.cc:434] P 0aa78544c8fb4f9cbf5ab1a935e18e82: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-034ac3e487504f54ac6e50430a0b22d7 on tablet 034ac3e487504f54ac6e50430a0b22d7 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:06.599607  6007 ts_tablet_manager.cc:933] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:06.601972  6007 tablet_copy_client.cc:323] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.67:43993
I20260709 12:26:06.606379  5232 tablet_copy_service.cc:140] P 6e72ecbdf12a4160856b2a57422118a3: Received BeginTabletCopySession request for tablet f3892e26d8f94adabf8bd2581fee782b from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:34832)
I20260709 12:26:06.606915  5232 tablet_copy_service.cc:161] P 6e72ecbdf12a4160856b2a57422118a3: Beginning new tablet copy session on tablet f3892e26d8f94adabf8bd2581fee782b from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:34832: session id = e030bb11bf104d5298a2521f8f7b206b-f3892e26d8f94adabf8bd2581fee782b
I20260709 12:26:06.615967  5232 tablet_copy_source_session.cc:215] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:06.621971  6007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3892e26d8f94adabf8bd2581fee782b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:06.637158  6007 tablet_copy_client.cc:806] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:06.637801  6007 tablet_copy_client.cc:670] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:06.641549  6007 tablet_copy_client.cc:538] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:06.648087  6007 tablet_bootstrap.cc:492] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:06.669602  6007 tablet_bootstrap.cc:492] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:06.670501  6007 tablet_bootstrap.cc:492] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:06.671057  6007 ts_tablet_manager.cc:1403] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.008s
I20260709 12:26:06.673300  6007 raft_consensus.cc:359] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:06.673959  6007 raft_consensus.cc:740] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:06.674484  6007 consensus_queue.cc:260] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:06.677220  6007 ts_tablet_manager.cc:1434] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:26:06.680136  5232 tablet_copy_service.cc:342] P 6e72ecbdf12a4160856b2a57422118a3: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-f3892e26d8f94adabf8bd2581fee782b received from {username='slave'} at 127.0.0.1:34832
I20260709 12:26:06.680608  5232 tablet_copy_service.cc:434] P 6e72ecbdf12a4160856b2a57422118a3: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-f3892e26d8f94adabf8bd2581fee782b on tablet f3892e26d8f94adabf8bd2581fee782b with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:06.706342  5743 raft_consensus.cc:1217] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:06.776968  5743 raft_consensus.cc:1217] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:06.886386  5743 raft_consensus.cc:1217] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:07.107247  5743 raft_consensus.cc:1217] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:07.128013  5972 raft_consensus.cc:1064] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:07.129812  5972 consensus_queue.cc:237] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:07.139281  5743 raft_consensus.cc:1275] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.139811  5222 raft_consensus.cc:1275] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.140625  5139 raft_consensus.cc:1275] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.140751  6014 consensus_queue.cc:1048] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.142797  5972 consensus_queue.cc:1048] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.151607  5972 consensus_queue.cc:1048] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.168812  6014 raft_consensus.cc:2955] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.171015  5743 raft_consensus.cc:2955] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.176120  5222 raft_consensus.cc:2955] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.193465  5139 raft_consensus.cc:2955] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.192055  4971 catalog_manager.cc:5697] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.259495  5065 consensus_queue.cc:237] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:07.265255  5742 raft_consensus.cc:1275] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:07.266531  5970 consensus_queue.cc:1048] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:07.266749  5139 raft_consensus.cc:1275] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:07.268977  5970 consensus_queue.cc:1048] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:07.273698  5972 raft_consensus.cc:2955] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.275223  5742 raft_consensus.cc:2955] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.280138  5139 raft_consensus.cc:2955] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.287111  4957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 034ac3e487504f54ac6e50430a0b22d7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:07.295852  4969 catalog_manager.cc:5697] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.309374  5204 tablet_service.cc:1558] Processing DeleteTablet for tablet 034ac3e487504f54ac6e50430a0b22d7 with delete_type TABLET_DATA_TOMBSTONED (TS 6e72ecbdf12a4160856b2a57422118a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37564
I20260709 12:26:07.311571  6023 tablet_replica.cc:333] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:07.312436  6023 raft_consensus.cc:2243] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:07.313169  6023 raft_consensus.cc:2272] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:07.316283  6023 ts_tablet_manager.cc:1916] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:07.329627  6023 ts_tablet_manager.cc:1929] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:07.330144  6023 log.cc:1199] T 034ac3e487504f54ac6e50430a0b22d7 P 6e72ecbdf12a4160856b2a57422118a3: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-2-root/wals/034ac3e487504f54ac6e50430a0b22d7
I20260709 12:26:07.332708  4958 catalog_manager.cc:5028] TS 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): tablet 034ac3e487504f54ac6e50430a0b22d7 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:07.343763  5890 raft_consensus.cc:1064] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:07.345841  5890 consensus_queue.cc:237] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:07.354509  5065 raft_consensus.cc:1275] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.356037  5935 consensus_queue.cc:1048] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.356385  5222 raft_consensus.cc:1275] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.363114  5742 raft_consensus.cc:1275] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.364805  5935 consensus_queue.cc:1048] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:07.390906  5905 consensus_queue.cc:1048] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:07.409117  5219 raft_consensus.cc:2955] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.407191  5905 raft_consensus.cc:2955] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.425379  5745 raft_consensus.cc:2955] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.432438  4969 catalog_manager.cc:5697] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.438813  5859 raft_consensus.cc:1064] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:07.441653  5859 consensus_queue.cc:237] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:07.449391  5070 raft_consensus.cc:2955] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.473917  5745 raft_consensus.cc:1275] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.476172  5148 raft_consensus.cc:1275] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.479481  5994 consensus_queue.cc:1048] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.488215  6013 consensus_queue.cc:1048] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:07.493711  5070 raft_consensus.cc:1275] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.498648  5994 consensus_queue.cc:1048] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.510259  5139 consensus_queue.cc:237] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:07.534901  5186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 47579.8us
I20260709 12:26:07.550989  5742 raft_consensus.cc:1275] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:07.552194  5222 raft_consensus.cc:1275] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:07.553354  6025 consensus_queue.cc:1048] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:07.557224  6025 consensus_queue.cc:1048] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:07.562008  5890 raft_consensus.cc:2955] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.562016  5994 raft_consensus.cc:2955] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.565994  5745 raft_consensus.cc:2955] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.587883  5222 raft_consensus.cc:2955] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.590329  5139 raft_consensus.cc:2955] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.589706  5742 raft_consensus.cc:2955] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.598430  4956 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 04f60339b6c34e54bbf6e9b4a4c1e54e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:07.596411  4970 catalog_manager.cc:5697] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.608546  4968 catalog_manager.cc:5697] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:07.644192  5187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 76178.8us
W20260709 12:26:07.706259  5112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:43655, user_credentials={real_user=slave}} blocked reactor thread for 71506.7us
I20260709 12:26:07.724253  5065 raft_consensus.cc:2955] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.728539  5060 tablet_service.cc:1558] Processing DeleteTablet for tablet 04f60339b6c34e54bbf6e9b4a4c1e54e with delete_type TABLET_DATA_TOMBSTONED (TS 0aa78544c8fb4f9cbf5ab1a935e18e82 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39330
I20260709 12:26:07.734210  6041 tablet_replica.cc:333] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:07.735462  6041 raft_consensus.cc:2243] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:07.736222  6041 raft_consensus.cc:2272] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:07.743659  5218 consensus_queue.cc:237] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:07.750353  6041 ts_tablet_manager.cc:1916] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:07.767294  6041 ts_tablet_manager.cc:1929] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:07.767745  6041 log.cc:1199] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root/wals/04f60339b6c34e54bbf6e9b4a4c1e54e
I20260709 12:26:07.769528  4957 catalog_manager.cc:5028] TS 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): tablet 04f60339b6c34e54bbf6e9b4a4c1e54e (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:07.775352  5742 raft_consensus.cc:1275] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:07.776201  5065 raft_consensus.cc:1275] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:07.781971  6030 raft_consensus.cc:1064] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:07.782496  6034 consensus_queue.cc:1048] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:07.784484  6030 consensus_queue.cc:237] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:07.786974  6035 consensus_queue.cc:1048] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:07.791822  6036 raft_consensus.cc:2955] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.800575  5745 raft_consensus.cc:2955] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.805295  5067 raft_consensus.cc:2955] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.812988  4958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 47ebaac790104c1b849ecbeadadc2ac6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:07.825013  5742 raft_consensus.cc:1275] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.829489  5148 raft_consensus.cc:1275] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.827394  4969 catalog_manager.cc:5697] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.838698  5065 raft_consensus.cc:1275] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.838794  6034 consensus_queue.cc:1048] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:07.840409  6030 consensus_queue.cc:1048] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:26:07.853912  5136 tablet_service.cc:1558] Processing DeleteTablet for tablet 47ebaac790104c1b849ecbeadadc2ac6 with delete_type TABLET_DATA_TOMBSTONED (TS d22f4ab7b09f42258209170e7c9214cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33554
I20260709 12:26:07.854764  6036 consensus_queue.cc:1048] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.872370  6044 tablet_replica.cc:333] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:07.878669  6044 raft_consensus.cc:2243] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:07.879613  6044 raft_consensus.cc:2272] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:07.881497  6034 raft_consensus.cc:2955] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.883874  6044 ts_tablet_manager.cc:1916] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:07.883229  5148 raft_consensus.cc:2955] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.897933  5065 raft_consensus.cc:2955] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.900739  4969 catalog_manager.cc:5697] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.905493  6044 ts_tablet_manager.cc:1929] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:07.906030  6044 log.cc:1199] T 47ebaac790104c1b849ecbeadadc2ac6 P d22f4ab7b09f42258209170e7c9214cb: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-1-root/wals/47ebaac790104c1b849ecbeadadc2ac6
I20260709 12:26:07.907858  4956 catalog_manager.cc:5028] TS d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): tablet 47ebaac790104c1b849ecbeadadc2ac6 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:07.916003  5742 raft_consensus.cc:2955] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.928128  5218 consensus_queue.cc:237] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:07.933977  5745 raft_consensus.cc:1275] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:07.935928  6035 consensus_queue.cc:1048] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:07.936124  5147 raft_consensus.cc:1275] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:07.938743  6035 consensus_queue.cc:1048] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:07.945341  6034 raft_consensus.cc:2955] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.951874  5147 raft_consensus.cc:2955] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.959061  4958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f3892e26d8f94adabf8bd2581fee782b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:07.961968  5745 raft_consensus.cc:2955] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:07.969938  4969 catalog_manager.cc:5697] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.983541  5060 tablet_service.cc:1558] Processing DeleteTablet for tablet f3892e26d8f94adabf8bd2581fee782b with delete_type TABLET_DATA_TOMBSTONED (TS 0aa78544c8fb4f9cbf5ab1a935e18e82 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39330
I20260709 12:26:07.984505  6041 tablet_replica.cc:333] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:07.993383  6041 raft_consensus.cc:2243] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:07.994266  6041 raft_consensus.cc:2272] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:07.998608  6041 ts_tablet_manager.cc:1916] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:08.012202  6041 ts_tablet_manager.cc:1929] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:08.012637  6041 log.cc:1199] T f3892e26d8f94adabf8bd2581fee782b P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root/wals/f3892e26d8f94adabf8bd2581fee782b
I20260709 12:26:08.014183  4957 catalog_manager.cc:5028] TS 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): tablet f3892e26d8f94adabf8bd2581fee782b (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:09.047766  5222 consensus_queue.cc:237] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:09.054334  5067 raft_consensus.cc:1275] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:09.056224  5186 consensus_peers.cc:597] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c3c3b60ecf04db989b454ae1f760212. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:09.057879  6030 consensus_queue.cc:1048] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:09.059656  5139 raft_consensus.cc:1275] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:09.062116  6034 consensus_queue.cc:1048] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:09.066892  6030 raft_consensus.cc:2955] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:09.069120  5067 raft_consensus.cc:2955] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:09.074239  5139 raft_consensus.cc:2955] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:09.087235  4968 catalog_manager.cc:5697] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:09.096086  5147 consensus_queue.cc:237] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:09.111531  5065 raft_consensus.cc:1275] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:09.112831  5222 raft_consensus.cc:1275] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:09.113016  6038 consensus_queue.cc:1048] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:09.114168  5112 consensus_peers.cc:597] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1640ee2f62349858037e353ecde48d8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:09.114853  6038 consensus_queue.cc:1048] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:09.124440  6047 raft_consensus.cc:2955] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:09.129089  5065 raft_consensus.cc:2955] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:09.131685  5222 raft_consensus.cc:2955] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:09.143554  5067 consensus_queue.cc:237] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:09.154770  4970 catalog_manager.cc:5697] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:09.166755  5222 raft_consensus.cc:1275] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:09.168763  5037 consensus_peers.cc:597] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 56941204ae3e40bba5254fad3092ebeb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:09.168828  5147 raft_consensus.cc:1275] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:09.169735  6040 consensus_queue.cc:1048] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:09.172650  6048 consensus_queue.cc:1048] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:09.186157  5972 raft_consensus.cc:2955] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:09.191978  5222 raft_consensus.cc:2955] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:09.197042  5139 raft_consensus.cc:2955] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:09.203573  4968 catalog_manager.cc:5697] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:09.204319  5218 consensus_queue.cc:237] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:09.221351  5067 raft_consensus.cc:1275] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:09.222518  5139 raft_consensus.cc:1275] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:09.224531  6050 consensus_queue.cc:1048] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:09.225466  5186 consensus_peers.cc:597] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ffee9280ebbb43bf892976cab5021757. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:09.227337  6034 consensus_queue.cc:1048] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:09.268764  6034 raft_consensus.cc:2955] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:09.270234  5139 raft_consensus.cc:2955] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:09.271826  5067 raft_consensus.cc:2955] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:09.288358  4969 catalog_manager.cc:5697] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:09.469512  6066 ts_tablet_manager.cc:933] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:09.471781  6066 tablet_copy_client.cc:323] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.67:43993
I20260709 12:26:09.473485  5232 tablet_copy_service.cc:140] P 6e72ecbdf12a4160856b2a57422118a3: Received BeginTabletCopySession request for tablet 8c3c3b60ecf04db989b454ae1f760212 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:34832)
I20260709 12:26:09.474052  5232 tablet_copy_service.cc:161] P 6e72ecbdf12a4160856b2a57422118a3: Beginning new tablet copy session on tablet 8c3c3b60ecf04db989b454ae1f760212 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:34832: session id = e030bb11bf104d5298a2521f8f7b206b-8c3c3b60ecf04db989b454ae1f760212
I20260709 12:26:09.484324  5232 tablet_copy_source_session.cc:215] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:09.487157  6066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3c3b60ecf04db989b454ae1f760212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:09.499891  6066 tablet_copy_client.cc:806] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:09.500478  6066 tablet_copy_client.cc:670] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:09.503810  6066 tablet_copy_client.cc:538] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:09.511713  6066 tablet_bootstrap.cc:492] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:09.527704  6066 tablet_bootstrap.cc:492] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:09.528602  6066 tablet_bootstrap.cc:492] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:09.529165  6066 ts_tablet_manager.cc:1403] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.008s
I20260709 12:26:09.531505  6066 raft_consensus.cc:359] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:09.532124  6066 raft_consensus.cc:740] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:09.532697  6066 consensus_queue.cc:260] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:09.538089  6066 ts_tablet_manager.cc:1434] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:09.539749  5232 tablet_copy_service.cc:342] P 6e72ecbdf12a4160856b2a57422118a3: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-8c3c3b60ecf04db989b454ae1f760212 received from {username='slave'} at 127.0.0.1:34832
I20260709 12:26:09.540129  5232 tablet_copy_service.cc:434] P 6e72ecbdf12a4160856b2a57422118a3: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-8c3c3b60ecf04db989b454ae1f760212 on tablet 8c3c3b60ecf04db989b454ae1f760212 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:09.643316  6066 ts_tablet_manager.cc:933] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:09.645162  6066 tablet_copy_client.cc:323] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.66:37067
I20260709 12:26:09.646762  5158 tablet_copy_service.cc:140] P d22f4ab7b09f42258209170e7c9214cb: Received BeginTabletCopySession request for tablet d1640ee2f62349858037e353ecde48d8 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:42108)
I20260709 12:26:09.647313  5158 tablet_copy_service.cc:161] P d22f4ab7b09f42258209170e7c9214cb: Beginning new tablet copy session on tablet d1640ee2f62349858037e353ecde48d8 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:42108: session id = e030bb11bf104d5298a2521f8f7b206b-d1640ee2f62349858037e353ecde48d8
I20260709 12:26:09.654896  5158 tablet_copy_source_session.cc:215] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:09.658018  6066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1640ee2f62349858037e353ecde48d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:09.664383  6071 ts_tablet_manager.cc:933] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:09.680820  6071 tablet_copy_client.cc:323] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.67:43993
I20260709 12:26:09.682574  5232 tablet_copy_service.cc:140] P 6e72ecbdf12a4160856b2a57422118a3: Received BeginTabletCopySession request for tablet ffee9280ebbb43bf892976cab5021757 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:34832)
I20260709 12:26:09.683137  5232 tablet_copy_service.cc:161] P 6e72ecbdf12a4160856b2a57422118a3: Beginning new tablet copy session on tablet ffee9280ebbb43bf892976cab5021757 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:34832: session id = e030bb11bf104d5298a2521f8f7b206b-ffee9280ebbb43bf892976cab5021757
I20260709 12:26:09.681136  6066 tablet_copy_client.cc:806] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:09.683884  6066 tablet_copy_client.cc:670] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:09.689299  6066 tablet_copy_client.cc:538] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:09.699079  5232 tablet_copy_source_session.cc:215] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:09.699553  6066 tablet_bootstrap.cc:492] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:09.702486  6071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffee9280ebbb43bf892976cab5021757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:09.736145  6073 ts_tablet_manager.cc:933] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149)
I20260709 12:26:09.731820  6071 tablet_copy_client.cc:806] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:09.745560  6071 tablet_copy_client.cc:670] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:09.746431  6073 tablet_copy_client.cc:323] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.65:37149
I20260709 12:26:09.749006  5083 tablet_copy_service.cc:140] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Received BeginTabletCopySession request for tablet 56941204ae3e40bba5254fad3092ebeb from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:53396)
I20260709 12:26:09.749584  5083 tablet_copy_service.cc:161] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Beginning new tablet copy session on tablet 56941204ae3e40bba5254fad3092ebeb from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:53396: session id = e030bb11bf104d5298a2521f8f7b206b-56941204ae3e40bba5254fad3092ebeb
I20260709 12:26:09.753039  6071 tablet_copy_client.cc:538] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:09.754379  6066 tablet_bootstrap.cc:492] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:09.755390  6066 tablet_bootstrap.cc:492] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:09.756079  6066 ts_tablet_manager.cc:1403] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.057s	user 0.026s	sys 0.004s
I20260709 12:26:09.758031  5083 tablet_copy_source_session.cc:215] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:09.761704  6073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56941204ae3e40bba5254fad3092ebeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:09.759120  6066 raft_consensus.cc:359] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:09.763561  6071 tablet_bootstrap.cc:492] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:09.763583  6066 raft_consensus.cc:740] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:09.768594  6066 consensus_queue.cc:260] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:09.772173  6066 ts_tablet_manager.cc:1434] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:26:09.776384  5158 tablet_copy_service.cc:342] P d22f4ab7b09f42258209170e7c9214cb: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-d1640ee2f62349858037e353ecde48d8 received from {username='slave'} at 127.0.0.1:42108
I20260709 12:26:09.776878  5158 tablet_copy_service.cc:434] P d22f4ab7b09f42258209170e7c9214cb: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-d1640ee2f62349858037e353ecde48d8 on tablet d1640ee2f62349858037e353ecde48d8 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:09.778741  6073 tablet_copy_client.cc:806] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:09.779361  6073 tablet_copy_client.cc:670] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:09.788240  6073 tablet_copy_client.cc:538] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:09.798455  6073 tablet_bootstrap.cc:492] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:09.810220  6071 tablet_bootstrap.cc:492] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:09.811189  6071 tablet_bootstrap.cc:492] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:09.811924  6071 ts_tablet_manager.cc:1403] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.010s
I20260709 12:26:09.815286  6071 raft_consensus.cc:359] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:09.816534  6071 raft_consensus.cc:740] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:09.817255  6071 consensus_queue.cc:260] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:09.819881  6071 ts_tablet_manager.cc:1434] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:26:09.821887  5232 tablet_copy_service.cc:342] P 6e72ecbdf12a4160856b2a57422118a3: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-ffee9280ebbb43bf892976cab5021757 received from {username='slave'} at 127.0.0.1:34832
I20260709 12:26:09.822299  5232 tablet_copy_service.cc:434] P 6e72ecbdf12a4160856b2a57422118a3: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-ffee9280ebbb43bf892976cab5021757 on tablet ffee9280ebbb43bf892976cab5021757 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:09.834750  6073 tablet_bootstrap.cc:492] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:09.835774  6073 tablet_bootstrap.cc:492] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:09.836498  6073 ts_tablet_manager.cc:1403] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.011s
I20260709 12:26:09.839421  6073 raft_consensus.cc:359] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:09.840312  6073 raft_consensus.cc:740] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:09.843408  6073 consensus_queue.cc:260] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:09.846066  6073 ts_tablet_manager.cc:1434] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:26:09.849447  5083 tablet_copy_service.cc:342] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-56941204ae3e40bba5254fad3092ebeb received from {username='slave'} at 127.0.0.1:53396
I20260709 12:26:09.849895  5083 tablet_copy_service.cc:434] P 0aa78544c8fb4f9cbf5ab1a935e18e82: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-56941204ae3e40bba5254fad3092ebeb on tablet 56941204ae3e40bba5254fad3092ebeb with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:09.930135  5745 raft_consensus.cc:1217] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:10.103089  5742 raft_consensus.cc:1217] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:10.172433  5742 raft_consensus.cc:1217] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:10.237691  5742 raft_consensus.cc:1217] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:10.504480  6079 raft_consensus.cc:1064] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:10.507004  6079 consensus_queue.cc:237] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:10.518980  5742 raft_consensus.cc:1275] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.520262  5139 raft_consensus.cc:1275] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.522420  5067 raft_consensus.cc:1275] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.522642  6030 consensus_queue.cc:1048] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.524957  6030 consensus_queue.cc:1048] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.525790  6082 consensus_queue.cc:1048] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.645330  6080 raft_consensus.cc:1064] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:10.647147  6080 consensus_queue.cc:237] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:10.670348  6079 raft_consensus.cc:2955] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.672592  5742 raft_consensus.cc:2955] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.696862  5065 raft_consensus.cc:2955] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.698582  5141 raft_consensus.cc:2955] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.702445  5745 raft_consensus.cc:1275] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.704363  6048 consensus_queue.cc:1048] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.706357  5218 raft_consensus.cc:1275] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.709569  6040 consensus_queue.cc:1048] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.715006  4970 catalog_manager.cc:5697] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:10.720412  5141 raft_consensus.cc:1275] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.722445  5972 consensus_queue.cc:1048] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:26:10.727748  5114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 86187.6us
I20260709 12:26:10.745659  5972 raft_consensus.cc:2955] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.747633  5905 raft_consensus.cc:1064] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:10.752595  5905 consensus_queue.cc:237] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:10.753921  5218 raft_consensus.cc:2955] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.751964  5139 raft_consensus.cc:2955] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.762099  5742 raft_consensus.cc:2955] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.764735  5745 raft_consensus.cc:1275] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.766978  5222 raft_consensus.cc:1275] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.767781  6078 consensus_queue.cc:1048] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.768833  6079 raft_consensus.cc:1064] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:10.769874  5066 raft_consensus.cc:1275] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.771688  6088 consensus_queue.cc:1048] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.795689  6078 consensus_queue.cc:1048] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.814390  6079 consensus_queue.cc:237] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:10.839435  5743 raft_consensus.cc:1275] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.843393  5147 raft_consensus.cc:1275] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.843465  6079 consensus_queue.cc:1048] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:10.845295  6030 consensus_queue.cc:1048] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.851982  5905 raft_consensus.cc:2955] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.855973  5744 raft_consensus.cc:2955] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.861848  5066 raft_consensus.cc:2955] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.880298  5067 raft_consensus.cc:1275] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.886421  5218 raft_consensus.cc:2955] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.891381  6079 consensus_queue.cc:1048] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:10.916934  6030 raft_consensus.cc:2955] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.918843  5743 raft_consensus.cc:2955] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.923617  5141 raft_consensus.cc:2955] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.929847  5066 raft_consensus.cc:2955] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.951251  4968 catalog_manager.cc:5697] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.955510  4968 catalog_manager.cc:5697] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.972779  5218 consensus_queue.cc:237] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:10.979669  4971 catalog_manager.cc:5697] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:10.981701  5743 raft_consensus.cc:1275] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.982968  6030 consensus_queue.cc:1048] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.985785  5066 raft_consensus.cc:1275] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.987215  6030 consensus_queue.cc:1048] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.990411  6082 raft_consensus.cc:2955] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.992110  5745 raft_consensus.cc:2955] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:10.999449  5147 consensus_queue.cc:237] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:11.008966  5067 consensus_queue.cc:237] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:11.012964  5744 raft_consensus.cc:1275] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:11.015041  5065 raft_consensus.cc:1275] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:11.015527  6078 consensus_queue.cc:1048] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:11.016108  5218 consensus_queue.cc:237] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:11.017459  6091 consensus_queue.cc:1048] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:11.024402  4958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8c3c3b60ecf04db989b454ae1f760212 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:11.038048  6088 raft_consensus.cc:2955] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:11.043782  5744 raft_consensus.cc:1275] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:11.040040  5065 raft_consensus.cc:2955] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:11.044469  5147 raft_consensus.cc:1275] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:11.045822  5744 raft_consensus.cc:2955] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:11.047063  6099 consensus_queue.cc:1048] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:11.050144  6099 consensus_queue.cc:1048] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:11.053282  4969 catalog_manager.cc:5697] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:11.057180  6100 raft_consensus.cc:2955] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:11.060462  5147 raft_consensus.cc:2955] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:11.070817  5148 raft_consensus.cc:1275] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:11.073118  6034 consensus_queue.cc:1048] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:11.074425  5745 raft_consensus.cc:2955] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:11.081179  6079 raft_consensus.cc:2955] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:11.096788  4957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 56941204ae3e40bba5254fad3092ebeb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:11.096639  4971 catalog_manager.cc:5697] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:11.098415  5147 raft_consensus.cc:2955] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:11.099246  4958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ffee9280ebbb43bf892976cab5021757 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:11.063452  5743 raft_consensus.cc:1275] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:11.104733  6079 consensus_queue.cc:1048] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:11.106235  5204 tablet_service.cc:1558] Processing DeleteTablet for tablet 56941204ae3e40bba5254fad3092ebeb with delete_type TABLET_DATA_TOMBSTONED (TS 6e72ecbdf12a4160856b2a57422118a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37564
I20260709 12:26:11.108618  6109 tablet_replica.cc:333] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:11.109936  6109 raft_consensus.cc:2243] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.110646  6109 raft_consensus.cc:2272] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.111765  5743 raft_consensus.cc:2955] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:11.116665  6109 ts_tablet_manager.cc:1916] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:11.121302  5067 raft_consensus.cc:2955] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:11.135234  4956 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d1640ee2f62349858037e353ecde48d8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:11.135516  4971 catalog_manager.cc:5697] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:11.153223  5136 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c3c3b60ecf04db989b454ae1f760212 with delete_type TABLET_DATA_TOMBSTONED (TS d22f4ab7b09f42258209170e7c9214cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33554
I20260709 12:26:11.156809  5204 tablet_service.cc:1558] Processing DeleteTablet for tablet d1640ee2f62349858037e353ecde48d8 with delete_type TABLET_DATA_TOMBSTONED (TS 6e72ecbdf12a4160856b2a57422118a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37564
I20260709 12:26:11.157467  4970 catalog_manager.cc:5697] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:11.169555  5060 tablet_service.cc:1558] Processing DeleteTablet for tablet ffee9280ebbb43bf892976cab5021757 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa78544c8fb4f9cbf5ab1a935e18e82 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39330
I20260709 12:26:11.171545  6109 ts_tablet_manager.cc:1929] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:11.172128  6109 log.cc:1199] T 56941204ae3e40bba5254fad3092ebeb P 6e72ecbdf12a4160856b2a57422118a3: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-2-root/wals/56941204ae3e40bba5254fad3092ebeb
I20260709 12:26:11.173009  6111 tablet_replica.cc:333] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:11.173900  4958 catalog_manager.cc:5028] TS 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): tablet 56941204ae3e40bba5254fad3092ebeb (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:11.174961  6109 tablet_replica.cc:333] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:11.176060  6109 raft_consensus.cc:2243] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.176851  6109 raft_consensus.cc:2272] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.177414  6111 raft_consensus.cc:2243] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.178285  6111 raft_consensus.cc:2272] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.185895  6110 tablet_replica.cc:333] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:11.186611  6111 ts_tablet_manager.cc:1916] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:11.187183  6110 raft_consensus.cc:2243] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:11.189244  6110 raft_consensus.cc:2272] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:11.191450  6109 ts_tablet_manager.cc:1916] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:11.199764  6110 ts_tablet_manager.cc:1916] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:11.208933  6111 ts_tablet_manager.cc:1929] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:11.209518  6111 log.cc:1199] T ffee9280ebbb43bf892976cab5021757 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root/wals/ffee9280ebbb43bf892976cab5021757
I20260709 12:26:11.211253  4957 catalog_manager.cc:5028] TS 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): tablet ffee9280ebbb43bf892976cab5021757 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:11.216846  6109 ts_tablet_manager.cc:1929] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:11.217402  6109 log.cc:1199] T d1640ee2f62349858037e353ecde48d8 P 6e72ecbdf12a4160856b2a57422118a3: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-2-root/wals/d1640ee2f62349858037e353ecde48d8
I20260709 12:26:11.219089  4958 catalog_manager.cc:5028] TS 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): tablet d1640ee2f62349858037e353ecde48d8 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:11.220165  6110 ts_tablet_manager.cc:1929] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:11.220721  6110 log.cc:1199] T 8c3c3b60ecf04db989b454ae1f760212 P d22f4ab7b09f42258209170e7c9214cb: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-1-root/wals/8c3c3b60ecf04db989b454ae1f760212
I20260709 12:26:11.222340  4956 catalog_manager.cc:5028] TS d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): tablet 8c3c3b60ecf04db989b454ae1f760212 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:12.252430  5222 consensus_queue.cc:237] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
W20260709 12:26:12.258803  5186 consensus_peers.cc:597] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f863b6a5fcc24d979cc005aaef6827ae. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:12.258847  5148 raft_consensus.cc:1275] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:12.258847  5066 raft_consensus.cc:1275] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:12.260442  6079 consensus_queue.cc:1048] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.261322  6112 consensus_queue.cc:1048] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.282939  6079 raft_consensus.cc:2955] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:12.285940  5139 raft_consensus.cc:2955] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:12.301618  4968 catalog_manager.cc:5697] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.304749  5222 consensus_queue.cc:237] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:12.307152  5066 raft_consensus.cc:2955] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:12.322942  5067 raft_consensus.cc:1275] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:12.324605  6113 consensus_queue.cc:1048] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.328725  5148 raft_consensus.cc:1275] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:12.329605  5186 consensus_peers.cc:597] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4eed62f347644556a405f7e6991cebf7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:12.330524  6113 consensus_queue.cc:1048] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.343770  6113 raft_consensus.cc:2955] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:12.346760  5148 raft_consensus.cc:2955] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:12.351063  5067 raft_consensus.cc:2955] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:12.365006  5066 consensus_queue.cc:237] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:12.370504  4970 catalog_manager.cc:5697] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.374668  5222 raft_consensus.cc:1275] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:12.375277  5037 consensus_peers.cc:597] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23c924d344cb49639d42d3f21aa08cf2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:12.376461  5148 raft_consensus.cc:1275] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:12.376397  6099 consensus_queue.cc:1048] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:12.377998  6114 consensus_queue.cc:1048] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.390705  6114 raft_consensus.cc:2955] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:12.391637  5148 raft_consensus.cc:2955] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:12.394322  5222 raft_consensus.cc:2955] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:12.406229  5148 consensus_queue.cc:237] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:12.407743  4968 catalog_manager.cc:5697] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
W20260709 12:26:12.417750  5112 consensus_peers.cc:597] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c62b8870a024d5692b8e8b85185dbd6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:12.419862  5222 raft_consensus.cc:1275] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:12.421005  5066 raft_consensus.cc:1275] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:12.422654  6115 consensus_queue.cc:1048] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.424326  6078 consensus_queue.cc:1048] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.434317  6078 raft_consensus.cc:2955] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:12.436540  5066 raft_consensus.cc:2955] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:12.438078  5222 raft_consensus.cc:2955] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:12.457370  4970 catalog_manager.cc:5697] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.715536  6133 ts_tablet_manager.cc:933] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:12.717340  6133 tablet_copy_client.cc:323] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.67:43993
I20260709 12:26:12.718824  5232 tablet_copy_service.cc:140] P 6e72ecbdf12a4160856b2a57422118a3: Received BeginTabletCopySession request for tablet 4eed62f347644556a405f7e6991cebf7 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:34832)
I20260709 12:26:12.719374  5232 tablet_copy_service.cc:161] P 6e72ecbdf12a4160856b2a57422118a3: Beginning new tablet copy session on tablet 4eed62f347644556a405f7e6991cebf7 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:34832: session id = e030bb11bf104d5298a2521f8f7b206b-4eed62f347644556a405f7e6991cebf7
I20260709 12:26:12.748137  5232 tablet_copy_source_session.cc:215] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:12.760439  6133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eed62f347644556a405f7e6991cebf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:12.763317  6136 ts_tablet_manager.cc:933] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149)
I20260709 12:26:12.781212  6136 tablet_copy_client.cc:323] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.65:37149
I20260709 12:26:12.783015  5083 tablet_copy_service.cc:140] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Received BeginTabletCopySession request for tablet 23c924d344cb49639d42d3f21aa08cf2 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:53396)
I20260709 12:26:12.783435  6133 tablet_copy_client.cc:806] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:12.783562  5083 tablet_copy_service.cc:161] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Beginning new tablet copy session on tablet 23c924d344cb49639d42d3f21aa08cf2 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:53396: session id = e030bb11bf104d5298a2521f8f7b206b-23c924d344cb49639d42d3f21aa08cf2
I20260709 12:26:12.784307  6133 tablet_copy_client.cc:670] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:12.792138  6133 tablet_copy_client.cc:538] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:12.801860  6133 tablet_bootstrap.cc:492] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:12.809295  5083 tablet_copy_source_session.cc:215] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:12.815791  6136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23c924d344cb49639d42d3f21aa08cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:12.822646  6133 tablet_bootstrap.cc:492] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.823650  6133 tablet_bootstrap.cc:492] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:12.824293  6133 ts_tablet_manager.cc:1403] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.009s
I20260709 12:26:12.827278  6133 raft_consensus.cc:359] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:12.828100  6133 raft_consensus.cc:740] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:12.828817  6133 consensus_queue.cc:260] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:12.838936  6133 ts_tablet_manager.cc:1434] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:26:12.840219  6136 tablet_copy_client.cc:806] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:12.840799  5232 tablet_copy_service.cc:342] P 6e72ecbdf12a4160856b2a57422118a3: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-4eed62f347644556a405f7e6991cebf7 received from {username='slave'} at 127.0.0.1:34832
I20260709 12:26:12.841295  5232 tablet_copy_service.cc:434] P 6e72ecbdf12a4160856b2a57422118a3: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-4eed62f347644556a405f7e6991cebf7 on tablet 4eed62f347644556a405f7e6991cebf7 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:12.842948  6136 tablet_copy_client.cc:670] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:12.851497  6133 ts_tablet_manager.cc:933] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:12.856005  6136 tablet_copy_client.cc:538] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:12.864522  6133 tablet_copy_client.cc:323] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.67:43993
I20260709 12:26:12.866235  5232 tablet_copy_service.cc:140] P 6e72ecbdf12a4160856b2a57422118a3: Received BeginTabletCopySession request for tablet f863b6a5fcc24d979cc005aaef6827ae from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:34832)
I20260709 12:26:12.866739  5232 tablet_copy_service.cc:161] P 6e72ecbdf12a4160856b2a57422118a3: Beginning new tablet copy session on tablet f863b6a5fcc24d979cc005aaef6827ae from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:34832: session id = e030bb11bf104d5298a2521f8f7b206b-f863b6a5fcc24d979cc005aaef6827ae
I20260709 12:26:12.874070  6136 tablet_bootstrap.cc:492] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:12.874459  5232 tablet_copy_source_session.cc:215] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:12.877439  6133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f863b6a5fcc24d979cc005aaef6827ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:12.900425  6136 tablet_bootstrap.cc:492] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.901310  6136 tablet_bootstrap.cc:492] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:12.902006  6136 ts_tablet_manager.cc:1403] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.004s
I20260709 12:26:12.901959  6133 tablet_copy_client.cc:806] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:12.902819  6133 tablet_copy_client.cc:670] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:12.905200  6136 raft_consensus.cc:359] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:12.906389  6136 raft_consensus.cc:740] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:12.907054  6133 tablet_copy_client.cc:538] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:12.906996  6136 consensus_queue.cc:260] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:12.909559  6136 ts_tablet_manager.cc:1434] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:26:12.912657  5083 tablet_copy_service.cc:342] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-23c924d344cb49639d42d3f21aa08cf2 received from {username='slave'} at 127.0.0.1:53396
I20260709 12:26:12.913067  5083 tablet_copy_service.cc:434] P 0aa78544c8fb4f9cbf5ab1a935e18e82: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-23c924d344cb49639d42d3f21aa08cf2 on tablet 23c924d344cb49639d42d3f21aa08cf2 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:12.921080  6133 tablet_bootstrap.cc:492] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:12.943794  6133 tablet_bootstrap.cc:492] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.944506  6133 tablet_bootstrap.cc:492] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:12.945101  6133 ts_tablet_manager.cc:1403] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.001s
I20260709 12:26:12.947206  6133 raft_consensus.cc:359] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:12.947801  6133 raft_consensus.cc:740] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:12.948365  6133 consensus_queue.cc:260] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:12.950210  6133 ts_tablet_manager.cc:1434] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:12.952142  5232 tablet_copy_service.cc:342] P 6e72ecbdf12a4160856b2a57422118a3: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-f863b6a5fcc24d979cc005aaef6827ae received from {username='slave'} at 127.0.0.1:34832
I20260709 12:26:12.952546  5232 tablet_copy_service.cc:434] P 6e72ecbdf12a4160856b2a57422118a3: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-f863b6a5fcc24d979cc005aaef6827ae on tablet f863b6a5fcc24d979cc005aaef6827ae with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:13.001466  6133 ts_tablet_manager.cc:933] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:13.003279  6133 tablet_copy_client.cc:323] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.66:37067
I20260709 12:26:13.004999  5158 tablet_copy_service.cc:140] P d22f4ab7b09f42258209170e7c9214cb: Received BeginTabletCopySession request for tablet 4c62b8870a024d5692b8e8b85185dbd6 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:42108)
I20260709 12:26:13.005564  5158 tablet_copy_service.cc:161] P d22f4ab7b09f42258209170e7c9214cb: Beginning new tablet copy session on tablet 4c62b8870a024d5692b8e8b85185dbd6 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:42108: session id = e030bb11bf104d5298a2521f8f7b206b-4c62b8870a024d5692b8e8b85185dbd6
I20260709 12:26:13.019214  5158 tablet_copy_source_session.cc:215] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:13.022541  6133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c62b8870a024d5692b8e8b85185dbd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.044863  6133 tablet_copy_client.cc:806] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:13.045459  6133 tablet_copy_client.cc:670] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:13.050186  6133 tablet_copy_client.cc:538] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:13.059491  6133 tablet_bootstrap.cc:492] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:13.079056  6133 tablet_bootstrap.cc:492] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.079988  6133 tablet_bootstrap.cc:492] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:13.080672  6133 ts_tablet_manager.cc:1403] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.009s
I20260709 12:26:13.084120  6133 raft_consensus.cc:359] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:13.085005  6133 raft_consensus.cc:740] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:13.085668  6133 consensus_queue.cc:260] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:13.087918  6133 ts_tablet_manager.cc:1434] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:13.090502  5158 tablet_copy_service.cc:342] P d22f4ab7b09f42258209170e7c9214cb: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-4c62b8870a024d5692b8e8b85185dbd6 received from {username='slave'} at 127.0.0.1:42108
I20260709 12:26:13.090900  5158 tablet_copy_service.cc:434] P d22f4ab7b09f42258209170e7c9214cb: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-4c62b8870a024d5692b8e8b85185dbd6 on tablet 4c62b8870a024d5692b8e8b85185dbd6 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:13.170004  5743 raft_consensus.cc:1217] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:13.310119  5743 raft_consensus.cc:1217] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:13.368582  5743 raft_consensus.cc:1217] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:13.384295  5743 raft_consensus.cc:1217] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:13.553691  6114 raft_consensus.cc:1064] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:13.557005  6114 consensus_queue.cc:237] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:13.564715  5743 raft_consensus.cc:1275] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.566133  5218 raft_consensus.cc:1275] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.567624  6114 consensus_queue.cc:1048] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.568367  5139 raft_consensus.cc:1275] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.569272  6099 consensus_queue.cc:1048] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.576363  6099 consensus_queue.cc:1048] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.594601  6135 raft_consensus.cc:2955] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:13.621078  5139 raft_consensus.cc:2955] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:13.617897  5218 raft_consensus.cc:2955] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:13.631623  5743 raft_consensus.cc:2955] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:13.645648  4968 catalog_manager.cc:5697] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:13.684439  5066 consensus_queue.cc:237] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:13.691354  5743 raft_consensus.cc:1275] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:13.693384  6150 consensus_queue.cc:1048] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:13.695533  5148 raft_consensus.cc:1275] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:13.702244  6151 consensus_queue.cc:1048] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:13.704623  6135 raft_consensus.cc:2955] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:13.707017  5745 raft_consensus.cc:2955] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:13.718480  5148 raft_consensus.cc:2955] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:13.725682  4969 catalog_manager.cc:5697] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:13.728758  4957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 23c924d344cb49639d42d3f21aa08cf2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:13.742853  5204 tablet_service.cc:1558] Processing DeleteTablet for tablet 23c924d344cb49639d42d3f21aa08cf2 with delete_type TABLET_DATA_TOMBSTONED (TS 6e72ecbdf12a4160856b2a57422118a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37564
I20260709 12:26:13.744849  6156 tablet_replica.cc:333] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:13.745862  6156 raft_consensus.cc:2243] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.746609  6156 raft_consensus.cc:2272] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.762856  6156 ts_tablet_manager.cc:1916] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:13.781322  6156 ts_tablet_manager.cc:1929] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:13.781682  6156 log.cc:1199] T 23c924d344cb49639d42d3f21aa08cf2 P 6e72ecbdf12a4160856b2a57422118a3: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-2-root/wals/23c924d344cb49639d42d3f21aa08cf2
I20260709 12:26:13.783026  4958 catalog_manager.cc:5028] TS 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): tablet 23c924d344cb49639d42d3f21aa08cf2 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:13.794037  6088 raft_consensus.cc:1064] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:13.796695  6088 consensus_queue.cc:237] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:13.803694  5222 raft_consensus.cc:1275] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.806051  5066 raft_consensus.cc:1275] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.807631  6115 consensus_queue.cc:1048] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:13.809991  6115 consensus_queue.cc:1048] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.817324  5745 raft_consensus.cc:1275] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.819324  6115 consensus_queue.cc:1048] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.829039  6113 raft_consensus.cc:1064] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:13.831552  6113 consensus_queue.cc:237] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:13.844353  5743 raft_consensus.cc:1275] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.847036  6078 raft_consensus.cc:2955] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:13.853960  5148 raft_consensus.cc:1275] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.854220  6113 consensus_queue.cc:1048] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.852434  5743 raft_consensus.cc:2955] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:13.858841  6119 consensus_queue.cc:1048] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:13.876828  5067 raft_consensus.cc:1275] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.884878  6119 consensus_queue.cc:1048] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.887518  6119 raft_consensus.cc:1064] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:13.891664  6119 consensus_queue.cc:237] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:13.891913  5066 raft_consensus.cc:2955] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:13.893997  6163 raft_consensus.cc:2955] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:13.896090  4970 catalog_manager.cc:5697] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:13.899438  5745 raft_consensus.cc:2955] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
W20260709 12:26:13.937134  5187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 52466.5us
I20260709 12:26:13.935539  4969 catalog_manager.cc:5697] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:13.956151  5218 raft_consensus.cc:2955] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:13.971731  5141 consensus_queue.cc:237] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:14.007462  5222 raft_consensus.cc:1275] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:14.015969  6088 consensus_queue.cc:1048] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:14.022579  6170 raft_consensus.cc:2955] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:14.024212  5218 raft_consensus.cc:2955] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:14.033967  4956 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4c62b8870a024d5692b8e8b85185dbd6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:14.053181  5745 raft_consensus.cc:1275] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:14.056629  6079 consensus_queue.cc:1048] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:26:14.088208  6171 log.cc:927] Time spent T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 12:26:14.115175  5187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 45839.1us
I20260709 12:26:14.129220  5065 raft_consensus.cc:1275] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:14.150704  5743 raft_consensus.cc:1275] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:14.151028  5139 raft_consensus.cc:1275] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:14.152629  5066 raft_consensus.cc:2955] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:14.152956  5143 raft_consensus.cc:2955] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:14.172263  6088 consensus_queue.cc:1048] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:14.177207  6163 consensus_queue.cc:1048] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:14.177217  5743 raft_consensus.cc:2955] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:14.181779  6119 consensus_queue.cc:1048] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:26:14.189620  4970 catalog_manager.cc:5697] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.200148  6167 raft_consensus.cc:2955] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:14.204492  5065 raft_consensus.cc:2955] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:14.221886  5743 raft_consensus.cc:2955] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:14.231844  4968 catalog_manager.cc:5697] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:14.241083  5060 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c62b8870a024d5692b8e8b85185dbd6 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa78544c8fb4f9cbf5ab1a935e18e82 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39330
I20260709 12:26:14.244863  6176 tablet_replica.cc:333] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:14.245959  6176 raft_consensus.cc:2243] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.217650  5143 raft_consensus.cc:2955] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:14.246913  6176 raft_consensus.cc:2272] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.250905  6176 ts_tablet_manager.cc:1916] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:14.261955  5218 consensus_queue.cc:237] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:14.261338  5222 consensus_queue.cc:237] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:14.270816  5071 raft_consensus.cc:1275] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:14.271402  5067 raft_consensus.cc:1275] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:14.272810  5741 raft_consensus.cc:1275] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:14.273345  6113 consensus_queue.cc:1048] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:14.274190  6079 consensus_queue.cc:1048] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:14.275147  6113 consensus_queue.cc:1048] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:14.271448  5740 raft_consensus.cc:1275] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:14.286922  6113 consensus_queue.cc:1048] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:14.286455  6079 raft_consensus.cc:2955] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:14.293071  5067 raft_consensus.cc:2955] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:14.296501  5740 raft_consensus.cc:2955] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:14.296290  6113 raft_consensus.cc:2955] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:14.301723  5743 raft_consensus.cc:2955] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:14.310854  4958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f863b6a5fcc24d979cc005aaef6827ae with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:14.314644  6176 ts_tablet_manager.cc:1929] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:14.319514  6176 log.cc:1199] T 4c62b8870a024d5692b8e8b85185dbd6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root/wals/4c62b8870a024d5692b8e8b85185dbd6
I20260709 12:26:14.327183  5065 raft_consensus.cc:2955] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:14.330431  4969 catalog_manager.cc:5697] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.332772  4957 catalog_manager.cc:5028] TS 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): tablet 4c62b8870a024d5692b8e8b85185dbd6 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:14.334751  4958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4eed62f347644556a405f7e6991cebf7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:14.326056  4971 catalog_manager.cc:5697] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:14.353566  5136 tablet_service.cc:1558] Processing DeleteTablet for tablet 4eed62f347644556a405f7e6991cebf7 with delete_type TABLET_DATA_TOMBSTONED (TS d22f4ab7b09f42258209170e7c9214cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33554
I20260709 12:26:14.361513  5133 tablet_service.cc:1558] Processing DeleteTablet for tablet f863b6a5fcc24d979cc005aaef6827ae with delete_type TABLET_DATA_TOMBSTONED (TS d22f4ab7b09f42258209170e7c9214cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33554
I20260709 12:26:14.364226  6178 tablet_replica.cc:333] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:14.365248  6178 raft_consensus.cc:2243] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.366019  6178 raft_consensus.cc:2272] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.369673  6178 ts_tablet_manager.cc:1916] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:14.382140  6178 ts_tablet_manager.cc:1929] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:14.382498  6178 log.cc:1199] T 4eed62f347644556a405f7e6991cebf7 P d22f4ab7b09f42258209170e7c9214cb: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-1-root/wals/4eed62f347644556a405f7e6991cebf7
I20260709 12:26:14.383883  4956 catalog_manager.cc:5028] TS d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): tablet 4eed62f347644556a405f7e6991cebf7 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:14.384027  6178 tablet_replica.cc:333] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:14.384982  6178 raft_consensus.cc:2243] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.385474  6178 raft_consensus.cc:2272] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.388615  6178 ts_tablet_manager.cc:1916] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:14.400672  6178 ts_tablet_manager.cc:1929] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:14.401046  6178 log.cc:1199] T f863b6a5fcc24d979cc005aaef6827ae P d22f4ab7b09f42258209170e7c9214cb: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-1-root/wals/f863b6a5fcc24d979cc005aaef6827ae
I20260709 12:26:14.402367  4956 catalog_manager.cc:5028] TS d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): tablet f863b6a5fcc24d979cc005aaef6827ae (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:15.435473  5147 consensus_queue.cc:237] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
W20260709 12:26:15.442791  5112 consensus_peers.cc:597] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73298cac061840a88d6e43468fbb541d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.443516  5067 raft_consensus.cc:1275] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:15.444638  5222 raft_consensus.cc:1275] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:15.446033  6088 consensus_queue.cc:1048] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:15.447077  6158 consensus_queue.cc:1048] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.455754  6158 raft_consensus.cc:2955] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:15.457508  5218 raft_consensus.cc:2955] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:15.458798  5067 raft_consensus.cc:2955] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:15.484398  4968 catalog_manager.cc:5697] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:15.488709  5222 consensus_queue.cc:237] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:15.506853  5067 raft_consensus.cc:1275] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:15.507771  5140 raft_consensus.cc:1275] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:15.508174  5186 consensus_peers.cc:597] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1704f04d7be4e899c5cf5d05207f303. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.509549  6188 consensus_queue.cc:1048] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:15.511480  6168 consensus_queue.cc:1048] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:15.536692  5067 raft_consensus.cc:2955] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:15.535106  6119 raft_consensus.cc:2955] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:15.542537  5140 raft_consensus.cc:2955] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:15.557358  4969 catalog_manager.cc:5697] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:15.568528  5147 consensus_queue.cc:237] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
W20260709 12:26:15.577824  5112 consensus_peers.cc:597] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f0b7d7401864a6cadec140ae4603df6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.578505  5222 raft_consensus.cc:1275] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:15.580013  6088 consensus_queue.cc:1048] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.582654  5067 raft_consensus.cc:1275] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:15.585618  6088 consensus_queue.cc:1048] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.589916  6180 raft_consensus.cc:2955] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:15.591509  5222 raft_consensus.cc:2955] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:15.603137  5067 raft_consensus.cc:2955] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:15.605891  5065 consensus_queue.cc:237] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:15.618109  5218 raft_consensus.cc:1275] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:15.617640  4969 catalog_manager.cc:5697] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:15.620903  6177 consensus_queue.cc:1048] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:15.623589  5147 raft_consensus.cc:1275] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:15.625085  5037 consensus_peers.cc:597] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 89a90aff4ede48ad8c6ef5d2ca6c1a5c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.626102  6099 consensus_queue.cc:1048] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.638381  6196 raft_consensus.cc:2955] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:15.640206  5218 raft_consensus.cc:2955] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:15.646374  5140 raft_consensus.cc:2955] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:15.658416  4969 catalog_manager.cc:5697] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:15.913607  6200 ts_tablet_manager.cc:933] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:15.915750  6200 tablet_copy_client.cc:323] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.66:37067
I20260709 12:26:15.917708  5158 tablet_copy_service.cc:140] P d22f4ab7b09f42258209170e7c9214cb: Received BeginTabletCopySession request for tablet 73298cac061840a88d6e43468fbb541d from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:42108)
I20260709 12:26:15.918238  5158 tablet_copy_service.cc:161] P d22f4ab7b09f42258209170e7c9214cb: Beginning new tablet copy session on tablet 73298cac061840a88d6e43468fbb541d from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:42108: session id = e030bb11bf104d5298a2521f8f7b206b-73298cac061840a88d6e43468fbb541d
I20260709 12:26:15.925590  5158 tablet_copy_source_session.cc:215] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:15.927965  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:15.928934  6200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73298cac061840a88d6e43468fbb541d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.947752  6200 tablet_copy_client.cc:806] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:15.948714  6200 tablet_copy_client.cc:670] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:15.953192  6200 tablet_copy_client.cc:538] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:15.963871  6200 tablet_bootstrap.cc:492] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:15.990566  6200 tablet_bootstrap.cc:492] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:15.991647  6200 tablet_bootstrap.cc:492] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:15.992424  6200 ts_tablet_manager.cc:1403] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.029s	user 0.024s	sys 0.001s
I20260709 12:26:15.995702  6200 raft_consensus.cc:359] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:15.996644  6200 raft_consensus.cc:740] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:15.997390  6200 consensus_queue.cc:260] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:16.007375  6200 ts_tablet_manager.cc:1434] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:26:16.014245  5158 tablet_copy_service.cc:342] P d22f4ab7b09f42258209170e7c9214cb: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-73298cac061840a88d6e43468fbb541d received from {username='slave'} at 127.0.0.1:42108
I20260709 12:26:16.014840  5158 tablet_copy_service.cc:434] P d22f4ab7b09f42258209170e7c9214cb: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-73298cac061840a88d6e43468fbb541d on tablet 73298cac061840a88d6e43468fbb541d with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:16.023535  5065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "034ac3e487504f54ac6e50430a0b22d7"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:16.024286  5065 raft_consensus.cc:606] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Received request to transfer leadership to TS e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:16.031553  6200 ts_tablet_manager.cc:933] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:16.036881  6200 tablet_copy_client.cc:323] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.66:37067
I20260709 12:26:16.045557  5140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c62b8870a024d5692b8e8b85185dbd6"
dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
mode: GRACEFUL
new_leader_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:59770
I20260709 12:26:16.046180  5140 raft_consensus.cc:606] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Received request to transfer leadership to TS e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:16.046736  5158 tablet_copy_service.cc:140] P d22f4ab7b09f42258209170e7c9214cb: Received BeginTabletCopySession request for tablet 8f0b7d7401864a6cadec140ae4603df6 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:42108)
I20260709 12:26:16.047283  5158 tablet_copy_service.cc:161] P d22f4ab7b09f42258209170e7c9214cb: Beginning new tablet copy session on tablet 8f0b7d7401864a6cadec140ae4603df6 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:42108: session id = e030bb11bf104d5298a2521f8f7b206b-8f0b7d7401864a6cadec140ae4603df6
I20260709 12:26:16.050966  5065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52040c8bb853412eae96ea2727c6f8f5"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "6e72ecbdf12a4160856b2a57422118a3"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:16.051654  5065 raft_consensus.cc:606] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Received request to transfer leadership to TS 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:26:16.054487  5065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ac38dc58d75468593dee0edaafb81c9"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "d22f4ab7b09f42258209170e7c9214cb"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:16.055006  5065 raft_consensus.cc:606] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Received request to transfer leadership to TS d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:16.060431  5158 tablet_copy_source_session.cc:215] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:16.063922  6200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f0b7d7401864a6cadec140ae4603df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:16.064713  5067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b10627fec43d464e94516d46e5afc694"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:16.065272  5067 raft_consensus.cc:606] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Received request to transfer leadership to TS e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:16.067725  5067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5afebfa702646d8b7372e8562e97d71"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "d22f4ab7b09f42258209170e7c9214cb"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:16.068267  5067 raft_consensus.cc:606] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Received request to transfer leadership to TS d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:16.070924  6196 raft_consensus.cc:993] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: : Instructing follower d22f4ab7b09f42258209170e7c9214cb to start an election
I20260709 12:26:16.071359  6196 raft_consensus.cc:1081] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Signalling peer d22f4ab7b09f42258209170e7c9214cb to start an election
I20260709 12:26:16.075120  5140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ac38dc58d75468593dee0edaafb81c9"
dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
 from {username='slave'} at 127.0.0.1:33564
I20260709 12:26:16.075680  5140 raft_consensus.cc:493] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:16.075999  5140 raft_consensus.cc:3060] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.082397  5140 raft_consensus.cc:515] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:16.096027  5067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac38dc58d75468593dee0edaafb81c9" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:16.097924  5067 raft_consensus.cc:3055] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:16.096940  5140 leader_election.cc:290] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:16.098234  5067 raft_consensus.cc:740] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:16.100324  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac38dc58d75468593dee0edaafb81c9" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:16.100905  5218 raft_consensus.cc:3060] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.102998  6177 raft_consensus.cc:993] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82: : Instructing follower e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:16.103475  6177 raft_consensus.cc:1081] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Signalling peer e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:16.105559  5740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "034ac3e487504f54ac6e50430a0b22d7"
dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:55096
I20260709 12:26:16.105633  5067 consensus_queue.cc:260] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:16.106124  5740 raft_consensus.cc:493] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:16.106500  5740 raft_consensus.cc:3060] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.106750  5067 raft_consensus.cc:3060] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.112248  5740 raft_consensus.cc:515] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:16.113400  6209 ts_tablet_manager.cc:933] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:16.115796  5218 raft_consensus.cc:2468] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 2.
I20260709 12:26:16.120160  5114 leader_election.cc:304] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:26:16.121100  6180 raft_consensus.cc:2804] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:16.121629  6180 raft_consensus.cc:697] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:26:16.122504  6180 consensus_queue.cc:237] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:16.134383  6177 raft_consensus.cc:993] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82: : Instructing follower 6e72ecbdf12a4160856b2a57422118a3 to start an election
I20260709 12:26:16.134896  6177 raft_consensus.cc:1081] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Signalling peer 6e72ecbdf12a4160856b2a57422118a3 to start an election
I20260709 12:26:16.135915  5071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034ac3e487504f54ac6e50430a0b22d7" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:16.136495  5071 raft_consensus.cc:3055] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:16.136780  5071 raft_consensus.cc:740] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:16.137531  5071 consensus_queue.cc:260] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:16.138689  5071 raft_consensus.cc:3060] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.141762  5740 leader_election.cc:290] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:16.141121  5140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034ac3e487504f54ac6e50430a0b22d7" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:16.145135  5067 raft_consensus.cc:2468] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 2.
I20260709 12:26:16.143846  5140 raft_consensus.cc:3060] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.145658  5218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52040c8bb853412eae96ea2727c6f8f5"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
 from {username='slave'} at 127.0.0.1:37568
I20260709 12:26:16.147213  5218 raft_consensus.cc:493] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:16.147697  5218 raft_consensus.cc:3060] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.152714  5219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d650634415db46289a46381b54dde329"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
mode: GRACEFUL
new_leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:52694
I20260709 12:26:16.153331  5219 raft_consensus.cc:606] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Received request to transfer leadership to TS 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:26:16.155422  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:26:16.157047  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:16.158095  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:16.167065  5071 raft_consensus.cc:2468] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:16.170285  5710 leader_election.cc:304] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:16.171872  6205 raft_consensus.cc:2804] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:16.183990  6200 tablet_copy_client.cc:806] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:16.186581  6200 tablet_copy_client.cc:670] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:16.187238  6180 raft_consensus.cc:993] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb: : Instructing follower e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:16.187727  6180 raft_consensus.cc:1081] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Signalling peer e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:16.188331  6209 tablet_copy_client.cc:323] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.67:43993
I20260709 12:26:16.188469  6205 raft_consensus.cc:697] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
I20260709 12:26:16.185245  5218 raft_consensus.cc:515] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:16.190752  5740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c62b8870a024d5692b8e8b85185dbd6"
dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:55094
I20260709 12:26:16.191597  5232 tablet_copy_service.cc:140] P 6e72ecbdf12a4160856b2a57422118a3: Received BeginTabletCopySession request for tablet d1704f04d7be4e899c5cf5d05207f303 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:34832)
I20260709 12:26:16.192716  6200 tablet_copy_client.cc:538] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:16.192876  5232 tablet_copy_service.cc:161] P 6e72ecbdf12a4160856b2a57422118a3: Beginning new tablet copy session on tablet d1704f04d7be4e899c5cf5d05207f303 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:34832: session id = e030bb11bf104d5298a2521f8f7b206b-d1704f04d7be4e899c5cf5d05207f303
I20260709 12:26:16.193691  6205 consensus_queue.cc:237] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:16.204041  5740 raft_consensus.cc:493] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:16.204829  5740 raft_consensus.cc:3060] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.213596  5140 raft_consensus.cc:2468] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:16.212706  4968 catalog_manager.cc:5697] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:16.223520  5232 tablet_copy_source_session.cc:215] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:16.231837  5071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52040c8bb853412eae96ea2727c6f8f5" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:16.232470  5071 raft_consensus.cc:3055] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:16.232843  5071 raft_consensus.cc:740] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:16.230243  5218 leader_election.cc:290] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:16.233773  5071 consensus_queue.cc:260] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:16.235226  5071 raft_consensus.cc:3060] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.236153  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52040c8bb853412eae96ea2727c6f8f5" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:16.236739  5143 raft_consensus.cc:3060] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.243225  5143 raft_consensus.cc:2468] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 2.
I20260709 12:26:16.248790  5071 raft_consensus.cc:2468] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 2.
I20260709 12:26:16.251657  6200 tablet_bootstrap.cc:492] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:16.252910  5187 leader_election.cc:304] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:26:16.253846  6113 raft_consensus.cc:2804] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:16.254280  6113 raft_consensus.cc:697] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:16.255316  6113 consensus_queue.cc:237] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:16.256317  6209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1704f04d7be4e899c5cf5d05207f303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:16.272955  5740 raft_consensus.cc:515] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:16.270666  4969 catalog_manager.cc:5697] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:16.284633  6200 tablet_bootstrap.cc:492] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.285759  6200 tablet_bootstrap.cc:492] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:16.286559  6200 ts_tablet_manager.cc:1403] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.007s
I20260709 12:26:16.289666  6200 raft_consensus.cc:359] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:16.290611  6200 raft_consensus.cc:740] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:16.290145  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c62b8870a024d5692b8e8b85185dbd6" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:16.292827  5143 raft_consensus.cc:3055] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:16.292248  6200 consensus_queue.cc:260] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:16.294483  6214 ts_tablet_manager.cc:933] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149)
I20260709 12:26:16.295715  6200 ts_tablet_manager.cc:1434] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:16.297559  5158 tablet_copy_service.cc:342] P d22f4ab7b09f42258209170e7c9214cb: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-8f0b7d7401864a6cadec140ae4603df6 received from {username='slave'} at 127.0.0.1:42108
I20260709 12:26:16.297982  5158 tablet_copy_service.cc:434] P d22f4ab7b09f42258209170e7c9214cb: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-8f0b7d7401864a6cadec140ae4603df6 on tablet 8f0b7d7401864a6cadec140ae4603df6 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:16.293141  5143 raft_consensus.cc:740] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:26:16.317960  5143 consensus_queue.cc:260] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:16.319159  5143 raft_consensus.cc:3060] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.329105  5740 leader_election.cc:290] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:16.331040  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c62b8870a024d5692b8e8b85185dbd6" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:16.331614  5218 raft_consensus.cc:3060] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.337545  6214 tablet_copy_client.cc:323] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.65:37149
I20260709 12:26:16.339514  5083 tablet_copy_service.cc:140] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Received BeginTabletCopySession request for tablet 89a90aff4ede48ad8c6ef5d2ca6c1a5c from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:53396)
I20260709 12:26:16.340050  5083 tablet_copy_service.cc:161] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Beginning new tablet copy session on tablet 89a90aff4ede48ad8c6ef5d2ca6c1a5c from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:53396: session id = e030bb11bf104d5298a2521f8f7b206b-89a90aff4ede48ad8c6ef5d2ca6c1a5c
I20260709 12:26:16.362636  5740 raft_consensus.cc:1217] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:16.365268  5218 raft_consensus.cc:2468] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:16.366900  5711 leader_election.cc:304] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:16.367763  6205 raft_consensus.cc:2804] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:16.368290  6205 raft_consensus.cc:697] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
I20260709 12:26:16.369202  6205 consensus_queue.cc:237] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:16.369473  4971 catalog_manager.cc:5697] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 2 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:16.380983  6209 tablet_copy_client.cc:806] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:16.381616  6209 tablet_copy_client.cc:670] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:16.384328  5143 raft_consensus.cc:2468] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:16.388207  6209 tablet_copy_client.cc:538] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:16.398043  5083 tablet_copy_source_session.cc:215] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:16.400456  6209 tablet_bootstrap.cc:492] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:16.401399  6214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a90aff4ede48ad8c6ef5d2ca6c1a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:16.403649  4968 catalog_manager.cc:5697] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 1 to 2, leader changed from d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:16.409750  6168 raft_consensus.cc:993] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3: : Instructing follower 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:16.410324  6113 raft_consensus.cc:1081] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Signalling peer 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:16.411895  5071 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d650634415db46289a46381b54dde329"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:36034
I20260709 12:26:16.412390  5071 raft_consensus.cc:493] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:16.412744  5071 raft_consensus.cc:3060] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.421032  5071 raft_consensus.cc:515] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:16.423703  5071 leader_election.cc:290] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:16.424614  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650634415db46289a46381b54dde329" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:16.424978  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650634415db46289a46381b54dde329" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:16.425190  5143 raft_consensus.cc:3060] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.425520  5218 raft_consensus.cc:3055] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:16.425863  5218 raft_consensus.cc:740] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
W20260709 12:26:16.426292  5113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 60947.4us
I20260709 12:26:16.426621  5218 consensus_queue.cc:260] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:16.427716  5218 raft_consensus.cc:3060] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.433204  5143 raft_consensus.cc:2468] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 2.
I20260709 12:26:16.435316  6214 tablet_copy_client.cc:806] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:16.435891  6214 tablet_copy_client.cc:670] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:16.436053  5037 leader_election.cc:304] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:26:16.437935  6099 raft_consensus.cc:2804] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:16.438351  6099 raft_consensus.cc:697] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:16.439061  6099 consensus_queue.cc:237] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:16.440613  6224 raft_consensus.cc:993] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82: : Instructing follower e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:16.441236  6224 raft_consensus.cc:1081] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Signalling peer e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:16.446687  6214 tablet_copy_client.cc:538] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:16.446947  5740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b10627fec43d464e94516d46e5afc694"
dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:55096
I20260709 12:26:16.447531  5740 raft_consensus.cc:493] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:16.447912  5740 raft_consensus.cc:3060] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.444308  5218 raft_consensus.cc:2468] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 2.
I20260709 12:26:16.452675  6196 raft_consensus.cc:993] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82: : Instructing follower d22f4ab7b09f42258209170e7c9214cb to start an election
I20260709 12:26:16.453152  6196 raft_consensus.cc:1081] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Signalling peer d22f4ab7b09f42258209170e7c9214cb to start an election
I20260709 12:26:16.456472  5143 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5afebfa702646d8b7372e8562e97d71"
dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
 from {username='slave'} at 127.0.0.1:33564
I20260709 12:26:16.456985  5143 raft_consensus.cc:493] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:16.457335  5143 raft_consensus.cc:3060] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.458875  5740 raft_consensus.cc:515] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:16.461886  5065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10627fec43d464e94516d46e5afc694" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:16.462437  5065 raft_consensus.cc:3055] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:16.462728  5065 raft_consensus.cc:740] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:16.463469  5065 consensus_queue.cc:260] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:16.464473  5065 raft_consensus.cc:3060] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.465780  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10627fec43d464e94516d46e5afc694" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:16.466622  5218 raft_consensus.cc:3060] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.472199  5143 raft_consensus.cc:515] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:16.472541  5740 leader_election.cc:290] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:16.475325  5067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5afebfa702646d8b7372e8562e97d71" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:16.475838  5067 raft_consensus.cc:3055] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:16.476130  5067 raft_consensus.cc:740] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:16.476408  5065 raft_consensus.cc:2468] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:16.476905  5067 consensus_queue.cc:260] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:16.477521  5710 leader_election.cc:304] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:16.477960  5067 raft_consensus.cc:3060] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.478348  6205 raft_consensus.cc:2804] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:16.478858  6205 raft_consensus.cc:697] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
I20260709 12:26:16.479701  6205 consensus_queue.cc:237] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:16.488216  5740 raft_consensus.cc:1217] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:16.491847  5218 raft_consensus.cc:2468] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:16.494058  6214 tablet_bootstrap.cc:492] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:16.510020  5067 raft_consensus.cc:2468] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 2.
I20260709 12:26:16.509578  4968 catalog_manager.cc:5697] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:16.512960  5143 leader_election.cc:290] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:16.517606  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5afebfa702646d8b7372e8562e97d71" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:16.517959  5113 leader_election.cc:304] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:26:16.518187  5218 raft_consensus.cc:3060] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.519523  6158 raft_consensus.cc:2804] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:16.519997  6158 raft_consensus.cc:697] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:26:16.520946  6158 consensus_queue.cc:237] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:16.539191  5218 raft_consensus.cc:2468] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 2.
I20260709 12:26:16.549952  4969 catalog_manager.cc:5697] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:16.620034  6209 tablet_bootstrap.cc:492] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.621414  6209 tablet_bootstrap.cc:492] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:16.622417  6209 ts_tablet_manager.cc:1403] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.222s	user 0.040s	sys 0.040s
I20260709 12:26:16.688439  4968 catalog_manager.cc:5697] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 1 to 2, leader changed from 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 2 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:16.722689  5147 raft_consensus.cc:1275] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:16.736505  6209 raft_consensus.cc:359] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:16.753721  6209 raft_consensus.cc:740] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:16.754308  6209 consensus_queue.cc:260] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:16.756331  6209 ts_tablet_manager.cc:1434] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.133s	user 0.005s	sys 0.007s
I20260709 12:26:16.759850  6214 tablet_bootstrap.cc:492] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.760851  6214 tablet_bootstrap.cc:492] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
W20260709 12:26:16.762748  5187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 180757us
I20260709 12:26:16.767125  5232 tablet_copy_service.cc:342] P 6e72ecbdf12a4160856b2a57422118a3: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-d1704f04d7be4e899c5cf5d05207f303 received from {username='slave'} at 127.0.0.1:34832
I20260709 12:26:16.767586  5232 tablet_copy_service.cc:434] P 6e72ecbdf12a4160856b2a57422118a3: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-d1704f04d7be4e899c5cf5d05207f303 on tablet d1704f04d7be4e899c5cf5d05207f303 with peer e030bb11bf104d5298a2521f8f7b206b
W20260709 12:26:16.773900  5114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 75905.3us
I20260709 12:26:16.761572  6214 ts_tablet_manager.cc:1403] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.268s	user 0.015s	sys 0.014s
I20260709 12:26:16.787108  5220 raft_consensus.cc:1275] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:16.807405  5066 raft_consensus.cc:1275] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:16.810304  5065 raft_consensus.cc:1275] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:16.810925  6212 consensus_queue.cc:1048] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:16.809500  6113 consensus_queue.cc:1048] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:26:16.822856  5065 raft_consensus.cc:1275] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:16.829243  6212 consensus_queue.cc:1048] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:16.867480  6236 consensus_queue.cc:1048] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:26:16.868824  6158 consensus_queue.cc:1048] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:16.878513  6214 raft_consensus.cc:359] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:16.879714  6214 raft_consensus.cc:740] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:16.881881  6236 raft_consensus.cc:1064] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:16.885027  6214 consensus_queue.cc:260] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:16.891119  6214 ts_tablet_manager.cc:1434] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.105s	user 0.007s	sys 0.000s
I20260709 12:26:16.908428  5139 raft_consensus.cc:1275] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:16.910019  6236 consensus_queue.cc:237] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:16.943786  5067 raft_consensus.cc:1275] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:16.943941  5083 tablet_copy_service.cc:342] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-89a90aff4ede48ad8c6ef5d2ca6c1a5c received from {username='slave'} at 127.0.0.1:53396
I20260709 12:26:16.944509  5083 tablet_copy_service.cc:434] P 0aa78544c8fb4f9cbf5ab1a935e18e82: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-89a90aff4ede48ad8c6ef5d2ca6c1a5c on tablet 89a90aff4ede48ad8c6ef5d2ca6c1a5c with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:16.962500  5221 raft_consensus.cc:1275] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:16.968659  6244 raft_consensus.cc:1064] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:16.990127  5139 raft_consensus.cc:1275] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:16.998013  6244 consensus_queue.cc:237] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:17.006340  6168 consensus_queue.cc:1048] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:26:17.075253  6205 consensus_queue.cc:1048] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:26:17.095520  5071 raft_consensus.cc:1275] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.102552  5065 raft_consensus.cc:1275] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:17.121554  6236 consensus_queue.cc:1048] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:26:17.121147  6252 consensus_queue.cc:1048] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:26:17.127434  6252 consensus_queue.cc:1048] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:17.133139  6232 consensus_queue.cc:1048] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 12:26:17.135273  5112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:43655, user_credentials={real_user=slave}} blocked reactor thread for 106611us
I20260709 12:26:17.145081  5740 raft_consensus.cc:1275] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.145256  5220 raft_consensus.cc:1275] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.155186  6180 consensus_queue.cc:1048] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:17.150120  5219 raft_consensus.cc:1275] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:17.147614  5711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 158616us
W20260709 12:26:17.144809  5187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 141381us
W20260709 12:26:17.152143  5037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 132755us
I20260709 12:26:17.160893  5139 raft_consensus.cc:1275] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:17.169394  6243 consensus_queue.cc:1048] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:26:17.175859  5219 raft_consensus.cc:1275] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:17.168888  6236 consensus_queue.cc:1048] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
W20260709 12:26:17.184578  5709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 94948.7us
I20260709 12:26:17.186618  5743 raft_consensus.cc:1217] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:17.223309  6240 consensus_queue.cc:1048] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:26:17.281495  6205 consensus_queue.cc:1048] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
W20260709 12:26:17.309449  5186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 320267us
I20260709 12:26:17.321419  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:17.308215  5710 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 290473us
W20260709 12:26:17.413396  6269 log.cc:927] Time spent T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:26:17.417004  6251 log.cc:927] Time spent T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Append to log took a long time: real 0.131s	user 0.000s	sys 0.003s
W20260709 12:26:17.520428  5709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 73713.9us
I20260709 12:26:17.580492  5741 raft_consensus.cc:1275] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.561129  6242 raft_consensus.cc:1064] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:17.590698  6242 consensus_queue.cc:237] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:17.646708  6232 consensus_queue.cc:1048] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:17.650594  5073 raft_consensus.cc:1275] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.655862  6244 consensus_queue.cc:1048] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:17.745307  5222 raft_consensus.cc:1275] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:17.746796  6199 raft_consensus.cc:2955] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:17.756209  5220 raft_consensus.cc:1275] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.773787  6180 consensus_queue.cc:1048] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:17.780807  5740 raft_consensus.cc:2955] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:17.848829  6212 raft_consensus.cc:493] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e72ecbdf12a4160856b2a57422118a3)
I20260709 12:26:17.859365  6212 raft_consensus.cc:515] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:17.867985  5113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 148037us
I20260709 12:26:17.872720  6212 leader_election.cc:290] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:17.882256  5740 raft_consensus.cc:1217] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:17.887153  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffee9280ebbb43bf892976cab5021757" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:26:17.921275  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffee9280ebbb43bf892976cab5021757" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:26:17.945199  5709 leader_election.cc:304] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e030bb11bf104d5298a2521f8f7b206b; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:17.950673  6230 consensus_queue.cc:1048] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:26:17.957620  6261 raft_consensus.cc:2749] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:17.967424  6199 raft_consensus.cc:2955] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:17.984670  5067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23c924d344cb49639d42d3f21aa08cf2"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:17.989446  5067 raft_consensus.cc:606] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Received request to transfer leadership to TS e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:17.970781  5219 raft_consensus.cc:2955] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:17.996547  5741 raft_consensus.cc:2955] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.017678  5744 raft_consensus.cc:1275] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:18.019078  5220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4799f16941ac411c958d31adc8dbd44a"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
mode: GRACEFUL
new_leader_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:52694
I20260709 12:26:18.019941  5220 raft_consensus.cc:606] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Received request to transfer leadership to TS e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:18.007797  5071 raft_consensus.cc:2955] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.026028  5140 raft_consensus.cc:1275] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:18.027040  6260 consensus_queue.cc:1048] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:26:18.036623  5222 raft_consensus.cc:2955] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.041613  6293 consensus_queue.cc:1048] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:26:18.046015  5073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b00d99b54ae4fda8d58410ef0b5c3e3"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:18.046794  5073 raft_consensus.cc:606] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Received request to transfer leadership to TS e030bb11bf104d5298a2521f8f7b206b
W20260709 12:26:18.053727  5186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 44853.4us
I20260709 12:26:18.054347  5073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d91e17c8c3b4cac9a128316050ce7df"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:18.056598  5073 raft_consensus.cc:606] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Received request to transfer leadership to TS e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:18.056190  4968 catalog_manager.cc:5697] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:18.072484  5073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccce9c827ef54c7fa65928fda3eb7acf"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "d22f4ab7b09f42258209170e7c9214cb"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:18.073103  5073 raft_consensus.cc:606] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Received request to transfer leadership to TS d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:18.077534  5139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1640ee2f62349858037e353ecde48d8"
dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
mode: GRACEFUL
new_leader_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:59770
I20260709 12:26:18.078106  5139 raft_consensus.cc:606] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Received request to transfer leadership to TS e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:18.079519  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:26:18.081174  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:18.082046  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:18.086438  5219 raft_consensus.cc:1275] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:18.093739  6231 consensus_queue.cc:1048] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:26:18.106145  5071 raft_consensus.cc:2955] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.139626  6275 raft_consensus.cc:993] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3: : Instructing follower e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:18.140110  6275 raft_consensus.cc:1081] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Signalling peer e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:18.142288  5740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4799f16941ac411c958d31adc8dbd44a"
dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:35796
I20260709 12:26:18.142824  5740 raft_consensus.cc:493] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:18.143167  5740 raft_consensus.cc:3060] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.147094  6231 raft_consensus.cc:2955] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.158926  5740 raft_consensus.cc:515] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:18.158192  5744 raft_consensus.cc:2955] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.165426  5139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4799f16941ac411c958d31adc8dbd44a" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:18.166108  5139 raft_consensus.cc:3060] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.166777  5140 raft_consensus.cc:2955] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.173362  5139 raft_consensus.cc:2468] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:18.174458  5709 leader_election.cc:304] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:18.175521  6263 raft_consensus.cc:2804] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:18.177357  5740 leader_election.cc:290] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:18.177595  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4799f16941ac411c958d31adc8dbd44a" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:18.178500  5222 raft_consensus.cc:3055] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:18.178858  5222 raft_consensus.cc:740] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:18.175931  5217 raft_consensus.cc:2955] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.179574  5222 consensus_queue.cc:260] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:18.181357  6263 raft_consensus.cc:697] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
I20260709 12:26:18.183136  6263 consensus_queue.cc:237] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:18.185969  6287 raft_consensus.cc:993] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb: : Instructing follower e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:18.186513  6232 raft_consensus.cc:1081] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Signalling peer e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:18.191548  5740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1640ee2f62349858037e353ecde48d8"
dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:55094
I20260709 12:26:18.192413  5740 raft_consensus.cc:493] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:18.192832  5740 raft_consensus.cc:3060] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.204830  5740 raft_consensus.cc:515] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:18.208186  5139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1640ee2f62349858037e353ecde48d8" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:18.209537  5139 raft_consensus.cc:3055] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:18.209863  5139 raft_consensus.cc:740] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:26:18.210568  5139 consensus_queue.cc:260] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:18.211597  5139 raft_consensus.cc:3060] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.212049  5222 raft_consensus.cc:3060] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.208186  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1640ee2f62349858037e353ecde48d8" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:18.212904  5073 raft_consensus.cc:3060] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.235056  5073 raft_consensus.cc:2468] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:18.237325  5710 leader_election.cc:304] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:18.238169  6212 raft_consensus.cc:2804] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:18.238669  6212 raft_consensus.cc:697] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
I20260709 12:26:18.239228  5740 leader_election.cc:290] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:18.239530  6212 consensus_queue.cc:237] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:18.219291  5139 raft_consensus.cc:2468] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:18.244481  5222 raft_consensus.cc:2468] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:18.289674  5139 consensus_queue.cc:237] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:18.313123  5065 raft_consensus.cc:1275] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:18.315137  6254 raft_consensus.cc:1064] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:18.315522  5740 raft_consensus.cc:1275] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:18.316461  6232 consensus_queue.cc:1048] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:18.319111  6254 consensus_queue.cc:237] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:18.324493  4968 catalog_manager.cc:5697] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:18.325274  6232 consensus_queue.cc:1048] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:18.342196  6232 raft_consensus.cc:2955] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.344343  5065 raft_consensus.cc:2955] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.355389  5740 raft_consensus.cc:2955] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.355393  4968 catalog_manager.cc:5697] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.376920  4966 catalog_manager.cc:5697] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 1 to 2, leader changed from d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:18.378785  4966 catalog_manager.cc:5697] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 1 to 2, leader changed from 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:18.380365  5069 raft_consensus.cc:1275] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:18.382401  6113 consensus_queue.cc:1048] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:18.388376  5143 consensus_queue.cc:237] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:18.389293  6231 raft_consensus.cc:993] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82: : Instructing follower d22f4ab7b09f42258209170e7c9214cb to start an election
I20260709 12:26:18.389866  6293 raft_consensus.cc:1081] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Signalling peer d22f4ab7b09f42258209170e7c9214cb to start an election
I20260709 12:26:18.392254  5139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccce9c827ef54c7fa65928fda3eb7acf"
dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
 from {username='slave'} at 127.0.0.1:33564
I20260709 12:26:18.392979  5139 raft_consensus.cc:493] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:18.393389  5139 raft_consensus.cc:3060] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.394502  5220 raft_consensus.cc:1275] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:18.397137  5740 raft_consensus.cc:1275] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:18.397640  6287 consensus_queue.cc:1048] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:18.398670  6199 consensus_queue.cc:1048] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:18.404536  5741 raft_consensus.cc:1275] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:18.408419  5140 raft_consensus.cc:1275] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:18.419442  5065 consensus_queue.cc:237] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:18.462868  5139 raft_consensus.cc:515] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:18.467346  5740 raft_consensus.cc:1275] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:18.468353  5220 raft_consensus.cc:2955] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.469551  6231 consensus_queue.cc:1048] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:18.476912  6240 raft_consensus.cc:993] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82: : Instructing follower e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:18.477430  6240 raft_consensus.cc:1081] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Signalling peer e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:18.481356  4971 catalog_manager.cc:5697] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.491652  6113 consensus_queue.cc:1048] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:18.493716  5204 tablet_service.cc:1558] Processing DeleteTablet for tablet 73298cac061840a88d6e43468fbb541d with delete_type TABLET_DATA_TOMBSTONED (TS 6e72ecbdf12a4160856b2a57422118a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37564
I20260709 12:26:18.493901  6113 consensus_queue.cc:1048] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:18.507858  4971 catalog_manager.cc:5697] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.513674  5740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23c924d344cb49639d42d3f21aa08cf2"
dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:55096
I20260709 12:26:18.514524  5740 raft_consensus.cc:493] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:18.514986  5740 raft_consensus.cc:3060] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.524892  5065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccce9c827ef54c7fa65928fda3eb7acf" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:18.528441  5139 leader_election.cc:290] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:18.533573  6240 raft_consensus.cc:993] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82: : Instructing follower e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:18.534126  6240 raft_consensus.cc:1081] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Signalling peer e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:18.537529  6306 tablet_replica.cc:333] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:18.539067  6306 raft_consensus.cc:2243] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.540237  6306 raft_consensus.cc:2272] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.496508  6199 raft_consensus.cc:2955] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.543561  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccce9c827ef54c7fa65928fda3eb7acf" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:18.544157  5220 raft_consensus.cc:3060] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.547340  6306 ts_tablet_manager.cc:1916] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:18.550184  5060 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f0b7d7401864a6cadec140ae4603df6 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa78544c8fb4f9cbf5ab1a935e18e82 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39330
I20260709 12:26:18.555172  5065 raft_consensus.cc:3055] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:18.555694  5065 raft_consensus.cc:740] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:18.557291  5065 consensus_queue.cc:260] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:18.558349  5065 raft_consensus.cc:3060] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.577081  5140 raft_consensus.cc:1275] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:18.581029  5147 raft_consensus.cc:1275] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:18.597518  6212 consensus_queue.cc:1048] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:18.565455  5744 raft_consensus.cc:2955] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.741029  5220 raft_consensus.cc:2468] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 2.
I20260709 12:26:18.743757  5740 raft_consensus.cc:515] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:18.746177  4956 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 73298cac061840a88d6e43468fbb541d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:18.753516  5740 leader_election.cc:290] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:18.755102  5114 leader_election.cc:304] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:26:18.755959  6244 raft_consensus.cc:2804] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:18.756453  6244 raft_consensus.cc:697] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:26:18.757418  6244 consensus_queue.cc:237] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:18.786257  5148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c924d344cb49639d42d3f21aa08cf2" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:18.786867  5148 raft_consensus.cc:3060] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.793835  5148 raft_consensus.cc:2468] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:18.798707  5219 raft_consensus.cc:1275] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:26:18.802713  5114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 47686.7us
W20260709 12:26:18.812911  5037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:43655, user_credentials={real_user=slave}} blocked reactor thread for 292748us
I20260709 12:26:18.801599  6263 consensus_queue.cc:1048] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:26:18.810413  6113 raft_consensus.cc:2955] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.819545  5744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b00d99b54ae4fda8d58410ef0b5c3e3"
dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:55096
I20260709 12:26:18.818434  5709 leader_election.cc:304] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:18.820096  5744 raft_consensus.cc:493] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:18.822788  5744 raft_consensus.cc:3060] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.831449  6212 raft_consensus.cc:2804] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:18.837397  4956 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8f0b7d7401864a6cadec140ae4603df6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:18.847295  5071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c924d344cb49639d42d3f21aa08cf2" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:18.848160  5071 raft_consensus.cc:3055] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:18.848611  5071 raft_consensus.cc:740] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:18.848445  5740 raft_consensus.cc:2955] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:18.849645  5071 consensus_queue.cc:260] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:18.850924  5065 raft_consensus.cc:2468] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 2.
I20260709 12:26:18.869189  5071 raft_consensus.cc:3060] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.880766  5744 raft_consensus.cc:515] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:18.887264  5069 raft_consensus.cc:1275] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:18.896327  5744 leader_election.cc:290] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:26:18.903929  5114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 75676us
W20260709 12:26:18.904851  5709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 75936.5us
I20260709 12:26:18.929471  5071 raft_consensus.cc:2468] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:18.904634  6212 raft_consensus.cc:697] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
I20260709 12:26:18.910898  6240 consensus_queue.cc:1048] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:26:18.972107  6308 tablet_replica.cc:333] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:18.986267  6308 raft_consensus.cc:2243] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:18.997881  5113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 99361.8us
I20260709 12:26:18.999989  6308 raft_consensus.cc:2272] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:19.003564  6306 ts_tablet_manager.cc:1929] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
W20260709 12:26:19.004828  6313 log.cc:927] Time spent T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:26:19.007236  6212 consensus_queue.cc:237] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:19.004339  6306 log.cc:1199] T 73298cac061840a88d6e43468fbb541d P 6e72ecbdf12a4160856b2a57422118a3: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-2-root/wals/73298cac061840a88d6e43468fbb541d
I20260709 12:26:19.022608  6308 ts_tablet_manager.cc:1916] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:19.025959  4971 catalog_manager.cc:5697] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:19.024296  5073 raft_consensus.cc:2955] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:19.044344  5141 raft_consensus.cc:2955] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
W20260709 12:26:19.083743  5037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 147569us
I20260709 12:26:19.092200  5143 raft_consensus.cc:1275] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:19.094543  6307 raft_consensus.cc:2955] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:19.107029  5071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00d99b54ae4fda8d58410ef0b5c3e3" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:19.107782  5071 raft_consensus.cc:3055] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.108269  5071 raft_consensus.cc:740] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:19.109200  5071 consensus_queue.cc:260] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:19.110034  5740 raft_consensus.cc:1240] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Rejecting Update request from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.110225  6320 consensus_queue.cc:1048] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:19.110319  5071 raft_consensus.cc:3060] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.109221  5744 raft_consensus.cc:2955] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:19.112418  6320 consensus_queue.cc:1048] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:19.176908  5141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b00d99b54ae4fda8d58410ef0b5c3e3" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:19.177701  5141 raft_consensus.cc:3060] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:19.178894  5187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 87854.6us
W20260709 12:26:19.183283  5037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 53974.8us
I20260709 12:26:19.206883  5141 raft_consensus.cc:2468] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:19.209219  5743 raft_consensus.cc:1240] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Rejecting Update request from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.243034  5071 raft_consensus.cc:2468] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:19.248265  4958 catalog_manager.cc:5028] TS 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): tablet 73298cac061840a88d6e43468fbb541d (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
W20260709 12:26:19.248998  4958 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 158637us
I20260709 12:26:19.256107  6241 raft_consensus.cc:993] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82: : Instructing follower e030bb11bf104d5298a2521f8f7b206b to start an election
W20260709 12:26:19.257205  5037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 73189us
I20260709 12:26:19.256510  6308 ts_tablet_manager.cc:1929] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:19.256690  6241 raft_consensus.cc:1081] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Signalling peer e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:19.268316  6308 log.cc:1199] T 8f0b7d7401864a6cadec140ae4603df6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root/wals/8f0b7d7401864a6cadec140ae4603df6
W20260709 12:26:19.290740  5187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 111144us
W20260709 12:26:19.295563  5113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 191309us
I20260709 12:26:19.297834  5709 leader_election.cc:304] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:19.299592  6324 raft_consensus.cc:2804] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.300112  6324 raft_consensus.cc:697] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
I20260709 12:26:19.301028  6324 consensus_queue.cc:237] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:19.339540  4957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 89a90aff4ede48ad8c6ef5d2ca6c1a5c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:19.340436  4957 catalog_manager.cc:5028] TS 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): tablet 8f0b7d7401864a6cadec140ae4603df6 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
W20260709 12:26:19.401968  4957 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 61534.5us
I20260709 12:26:19.383769  4968 catalog_manager.cc:5697] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:19.437408  5037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 168922us
W20260709 12:26:19.438653  5186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 123737us
I20260709 12:26:19.409371  5219 consensus_queue.cc:237] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:19.457818  5113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 49256.8us
W20260709 12:26:19.461853  5114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 143349us
W20260709 12:26:19.464649  5187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 79039.7us
I20260709 12:26:19.501489  5066 raft_consensus.cc:1275] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:19.513623  5744 raft_consensus.cc:1275] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:19.514496  5065 raft_consensus.cc:1275] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:19.520332  6235 consensus_queue.cc:1048] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:19.533020  6243 consensus_queue.cc:1048] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.535065  4966 catalog_manager.cc:5697] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.548303  5740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d91e17c8c3b4cac9a128316050ce7df"
dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:55096
I20260709 12:26:19.549197  5740 raft_consensus.cc:493] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:19.549634  5740 raft_consensus.cc:3060] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.557168  6235 raft_consensus.cc:2955] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:19.562016  5067 raft_consensus.cc:2955] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
W20260709 12:26:19.666760  5114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 204042us
I20260709 12:26:19.777304  5221 raft_consensus.cc:1275] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:19.782783  5740 raft_consensus.cc:515] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:19.784509  5148 raft_consensus.cc:2955] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:19.792780  6347 consensus_queue.cc:1048] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:19.793210  5186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:43655, user_credentials={real_user=slave}} blocked reactor thread for 225964us
W20260709 12:26:19.795415  5039 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 231326us
I20260709 12:26:19.790170  4968 catalog_manager.cc:5697] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:19.802675  4958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d1704f04d7be4e899c5cf5d05207f303 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:19.803797  5744 raft_consensus.cc:1240] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Rejecting Update request from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.826503  5740 leader_election.cc:290] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:19.828832  6113 consensus_queue.cc:1048] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:19.843128  5139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d91e17c8c3b4cac9a128316050ce7df" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:19.843704  5139 raft_consensus.cc:3060] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.859215  6307 consensus_queue.cc:1059] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:19.860306  6307 raft_consensus.cc:3055] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.863722  6307 raft_consensus.cc:740] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:19.864578  6307 consensus_queue.cc:260] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:19.865774  6307 raft_consensus.cc:3060] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.871448  5067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d91e17c8c3b4cac9a128316050ce7df" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:19.826206  6235 raft_consensus.cc:493] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:19.876703  6235 raft_consensus.cc:515] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:19.877314  5070 raft_consensus.cc:1275] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:19.879431  6235 leader_election.cc:290] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:19.881557  5147 raft_consensus.cc:1275] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:19.882287  5139 raft_consensus.cc:2468] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:19.881410  6314 consensus_queue.cc:1048] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:26:19.883239  5143 raft_consensus.cc:1240] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Rejecting Update request from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.888805  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a90aff4ede48ad8c6ef5d2ca6c1a5c" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:26:19.902731  5143 raft_consensus.cc:1275] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:19.906840  5709 leader_election.cc:304] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:19.908075  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:19.916621  6263 consensus_queue.cc:1048] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:19.919593  6263 raft_consensus.cc:2804] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.920296  6263 raft_consensus.cc:697] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
I20260709 12:26:19.921226  6263 consensus_queue.cc:237] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:19.930073  5744 raft_consensus.cc:2955] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:19.963510  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a90aff4ede48ad8c6ef5d2ca6c1a5c" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:26:19.976447  5740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a90aff4ede48ad8c6ef5d2ca6c1a5c" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
I20260709 12:26:19.981705  5067 raft_consensus.cc:2468] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:19.933874  6324 consensus_queue.cc:1048] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:26:19.993602  5066 raft_consensus.cc:1275] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:20.005297  5186 leader_election.cc:304] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:20.006469  6334 raft_consensus.cc:2749] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:20.013386  4971 catalog_manager.cc:5697] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:20.029973  6263 consensus_queue.cc:1048] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:20.033699  5204 tablet_service.cc:1558] Processing DeleteTablet for tablet 89a90aff4ede48ad8c6ef5d2ca6c1a5c with delete_type TABLET_DATA_TOMBSTONED (TS 6e72ecbdf12a4160856b2a57422118a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37564
W20260709 12:26:20.233101  6299 log.cc:927] Time spent T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
W20260709 12:26:20.365139  6363 log.cc:927] Time spent T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
I20260709 12:26:20.408695  6367 tablet_replica.cc:333] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
W20260709 12:26:20.420504  6359 log.cc:927] Time spent T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 12:26:20.588131  6320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.009s	sys 0.022s
W20260709 12:26:20.593818  5143 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.009s	sys 0.010s
I20260709 12:26:20.594022  6199 raft_consensus.cc:493] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e72ecbdf12a4160856b2a57422118a3)
W20260709 12:26:20.594506  6320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.009s	sys 0.022s
I20260709 12:26:20.594660  6199 raft_consensus.cc:515] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:20.594221  5143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.009s	sys 0.010s
I20260709 12:26:20.597514  6199 leader_election.cc:290] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:20.598685  5740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1704f04d7be4e899c5cf5d05207f303" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
W20260709 12:26:20.601758  5709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 230500us
I20260709 12:26:20.627104  5217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1704f04d7be4e899c5cf5d05207f303" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:26:20.724232  6379 raft_consensus.cc:493] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:20.724864  6379 raft_consensus.cc:515] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:20.726938  6379 leader_election.cc:290] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:20.837446  6367 raft_consensus.cc:2243] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.867072  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1704f04d7be4e899c5cf5d05207f303" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:26:20.871232  6374 raft_consensus.cc:493] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.871690  6374 raft_consensus.cc:515] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:20.873759  6374 leader_election.cc:290] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
W20260709 12:26:20.875046  5186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 250837us
I20260709 12:26:20.876919  5113 leader_election.cc:304] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:20.877139  6367 raft_consensus.cc:2272] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.881062  5143 raft_consensus.cc:1275] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:20.883603  6199 raft_consensus.cc:2749] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:20.883522  5073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c924d344cb49639d42d3f21aa08cf2" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:26:20.887604  6367 ts_tablet_manager.cc:1916] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:26:20.901548  5066 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.006s	sys 0.008s
W20260709 12:26:20.901969  5066 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.007s	sys 0.008s
I20260709 12:26:20.903842  5067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53396 (request call id 44) took 1039 ms. Trace:
I20260709 12:26:20.904301  5067 rpcz_store.cc:276] 0709 12:26:19.868393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:19.868859 (+   466us) service_pool.cc:224] Handling call
0709 12:26:20.903652 (+1034793us) spinlock_profiling.cc:243] Waited 93.8 ms on lock 0x7b54001f13d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:26:20.903763 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215700864}
I20260709 12:26:20.906844  5064 raft_consensus.cc:1275] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:20.918728  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f147c4f5ae9479dae2779366c7cf2fe" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:26:20.925798  6367 ts_tablet_manager.cc:1929] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:20.926414  6367 log.cc:1199] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 6e72ecbdf12a4160856b2a57422118a3: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-2-root/wals/89a90aff4ede48ad8c6ef5d2ca6c1a5c
I20260709 12:26:20.934674  4958 catalog_manager.cc:5028] TS 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): tablet 89a90aff4ede48ad8c6ef5d2ca6c1a5c (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:20.997709  6263 consensus_queue.cc:1048] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:21.010043  6347 raft_consensus.cc:493] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:21.010592  6347 raft_consensus.cc:515] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:21.012593  6347 leader_election.cc:290] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:21.017843  5070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b00d99b54ae4fda8d58410ef0b5c3e3"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:21.022125  5742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c924d344cb49639d42d3f21aa08cf2" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
I20260709 12:26:21.024303  4971 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35862 (request call id 256) took 1198 ms. Trace:
I20260709 12:26:21.024402  4967 catalog_manager.cc:5697] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:21.025447  5136 tablet_service.cc:1558] Processing DeleteTablet for tablet d1704f04d7be4e899c5cf5d05207f303 with delete_type TABLET_DATA_TOMBSTONED (TS d22f4ab7b09f42258209170e7c9214cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33554
I20260709 12:26:21.024766  4971 rpcz_store.cc:276] 0709 12:26:19.826099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:19.827299 (+  1200us) service_pool.cc:224] Handling call
0709 12:26:19.916116 (+ 88817us) spinlock_profiling.cc:243] Waited 65.1 ms on lock 0x7b540039f154. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817e090 00007f287821cf3a 00007f287dfd2e9c 00007f287e0d104e 00007f287c5922a4 00007f287c592232 00007f287c592161 00007f287c5920dc 00007f287c591392 00007f287654f48c 00007f287654e8c6
0709 12:26:21.024194 (+1108078us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:20.056488 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:20.063349 (+  6861us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:20.063398 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:26:20.063422 (+    24us) tablet.cc:662] Decoding operations
0709 12:26:20.063821 (+   399us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:20.063890 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:20.063919 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:20.064122 (+   203us) tablet.cc:701] Row locks acquired
0709 12:26:20.064137 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:26:20.064276 (+   139us) write_op.cc:270] Start()
0709 12:26:20.064417 (+   141us) write_op.cc:276] Timestamp: P: 1783599980064231 usec, L: 0
0709 12:26:20.064439 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:26:20.065060 (+   621us) log.cc:844] Serialized 533 byte log entry
0709 12:26:20.234727 (+169667us) op_driver.cc:464] REPLICATION: finished
0709 12:26:20.235160 (+   433us) write_op.cc:301] APPLY: starting
0709 12:26:20.235232 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:20.235328 (+    96us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:20.235421 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:20.235656 (+   235us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:20.235798 (+   142us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:20.235840 (+    42us) write_op.cc:312] APPLY: finished
0709 12:26:20.236037 (+   197us) log.cc:844] Serialized 23 byte log entry
0709 12:26:20.236184 (+   147us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:20.236260 (+    76us) write_op.cc:454] Released schema lock
0709 12:26:20.236298 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:20.236593 (+   295us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:20.236617 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":201,"reported_tablets":1,"spinlock_wait_cycles":149803776,"child_traces":[["op",{"apply.queue_time_us":251,"apply.run_cpu_time_us":1384,"apply.run_wall_time_us":1383,"num_ops":1,"prepare.queue_time_us":318,"prepare.run_cpu_time_us":2756,"prepare.run_wall_time_us":13389,"replication_time_us":170152}]]}
I20260709 12:26:21.038441  5064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56941204ae3e40bba5254fad3092ebeb" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" is_pre_election: true
I20260709 12:26:21.045814  6388 tablet_replica.cc:333] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:21.047936  6320 consensus_queue.cc:1048] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:21.049676  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56941204ae3e40bba5254fad3092ebeb" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
I20260709 12:26:21.057898  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f147c4f5ae9479dae2779366c7cf2fe" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:26:21.064919  5071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53396 (request call id 50) took 1003 ms. Trace:
I20260709 12:26:21.065366  5071 rpcz_store.cc:276] 0709 12:26:20.061832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.066725 (+  4893us) service_pool.cc:224] Handling call
0709 12:26:20.068311 (+  1586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:20.068564 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:26:21.061283 (+992719us) log.cc:844] Serialized 14 byte log entry
0709 12:26:21.064603 (+  3320us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:21.064655 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:21.064695 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:21.064757 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:21.064849 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4928,"raft.queue_time_us":187,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"thread_start_us":33227,"threads_started":2,"wal-append.queue_time_us":1599}
I20260709 12:26:21.078404  4967 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33648 (request call id 140) took 1505 ms. Trace:
I20260709 12:26:21.083038  5070 raft_consensus.cc:606] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Received request to transfer leadership to TS e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:21.088760  5070 raft_consensus.cc:614] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:21.094468  5070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d91e17c8c3b4cac9a128316050ce7df"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:21.101456  5070 raft_consensus.cc:606] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Received request to transfer leadership to TS e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:21.108695  5070 raft_consensus.cc:614] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:21.118168  4966 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35846 (request call id 234) took 1177 ms. Trace:
I20260709 12:26:21.118736  4966 rpcz_store.cc:276] 0709 12:26:19.940323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:19.943883 (+  3560us) service_pool.cc:224] Handling call
0709 12:26:21.118102 (+1174219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10644,"reported_tablets":4}
I20260709 12:26:21.095043  4967 rpcz_store.cc:276] 0709 12:26:19.572993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:19.780020 (+207027us) service_pool.cc:224] Handling call
0709 12:26:19.891870 (+111850us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540039f154. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817e090 00007f287821cf3a 00007f287dfd2e9c 00007f287e0d104e 00007f287c5922a4 00007f287c592232 00007f287c592161 00007f287c5920dc 00007f287c591392 00007f287654f48c 00007f287654e8c6
0709 12:26:21.078336 (+1186466us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:21.041580 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:21.043251 (+  1671us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:21.043302 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:26:21.043329 (+    27us) tablet.cc:662] Decoding operations
0709 12:26:21.043716 (+   387us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:21.043795 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:21.043845 (+    50us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:21.044095 (+   250us) tablet.cc:701] Row locks acquired
0709 12:26:21.044122 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:26:21.044325 (+   203us) write_op.cc:270] Start()
0709 12:26:21.044470 (+   145us) write_op.cc:276] Timestamp: P: 1783599981044265 usec, L: 0
0709 12:26:21.044501 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:26:21.050802 (+  6301us) log.cc:844] Serialized 533 byte log entry
0709 12:26:21.065046 (+ 14244us) op_driver.cc:464] REPLICATION: finished
0709 12:26:21.068806 (+  3760us) write_op.cc:301] APPLY: starting
0709 12:26:21.068878 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:21.068969 (+    91us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:21.069098 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:21.069348 (+   250us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:21.069501 (+   153us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:21.069544 (+    43us) write_op.cc:312] APPLY: finished
0709 12:26:21.069707 (+   163us) log.cc:844] Serialized 23 byte log entry
0709 12:26:21.070416 (+   709us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:21.070494 (+    78us) write_op.cc:454] Released schema lock
0709 12:26:21.070535 (+    41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":14574,"reported_tablets":4,"spinlock_wait_cycles":252899072,"child_traces":[["op",{"apply.queue_time_us":3567,"num_ops":1,"prepare.queue_time_us":13370,"prepare.run_cpu_time_us":3139,"prepare.run_wall_time_us":18028,"replication_time_us":20416,"thread_start_us":14749,"threads_started":2}]]}
I20260709 12:26:21.049675  6388 raft_consensus.cc:2243] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:21.127261  6388 raft_consensus.cc:2272] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.137404  6388 ts_tablet_manager.cc:1916] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:21.130055  5112 leader_election.cc:304] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:21.143141  6376 raft_consensus.cc:2749] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:21.142635  5112 leader_election.cc:304] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:21.148177  6376 raft_consensus.cc:2749] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:21.150815  5037 leader_election.cc:304] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:21.151860  6381 raft_consensus.cc:2749] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:21.144409  4967 catalog_manager.cc:5697] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:21.158802  5141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c83bfe7fc28a4548aa8923c761e8108d"
dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
mode: GRACEFUL
new_leader_uuid: "6e72ecbdf12a4160856b2a57422118a3"
 from {username='slave'} at 127.0.0.1:59770
I20260709 12:26:21.159658  5141 raft_consensus.cc:606] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Received request to transfer leadership to TS 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:26:21.169165  5219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5b732ffbeea492c9c4d91376c781263"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
mode: GRACEFUL
new_leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:52694
I20260709 12:26:21.169929  5219 raft_consensus.cc:606] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Received request to transfer leadership to TS 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:26:21.173817  5219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8da98a042af4ca9ac0ae86911498913"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
mode: GRACEFUL
new_leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:52694
I20260709 12:26:21.174608  5219 raft_consensus.cc:606] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Received request to transfer leadership to TS 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:26:21.175851  6388 ts_tablet_manager.cc:1929] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:21.176332  6388 log.cc:1199] T d1704f04d7be4e899c5cf5d05207f303 P d22f4ab7b09f42258209170e7c9214cb: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-1-root/wals/d1704f04d7be4e899c5cf5d05207f303
I20260709 12:26:21.178232  4956 catalog_manager.cc:5028] TS d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): tablet d1704f04d7be4e899c5cf5d05207f303 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:21.187829  5219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffee9280ebbb43bf892976cab5021757"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
mode: GRACEFUL
new_leader_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:52694
I20260709 12:26:21.188809  5219 raft_consensus.cc:606] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Received request to transfer leadership to TS e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:21.199370  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:26:21.201184  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:21.202003  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:21.210413  6237 raft_consensus.cc:993] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3: : Instructing follower 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:21.211139  6345 raft_consensus.cc:1081] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Signalling peer 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:21.220700  5070 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5b732ffbeea492c9c4d91376c781263"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:36034
I20260709 12:26:21.221277  5070 raft_consensus.cc:493] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:21.221643  5070 raft_consensus.cc:3060] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.228387  5070 raft_consensus.cc:515] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:21.231019  5070 leader_election.cc:290] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:21.231366  5139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b732ffbeea492c9c4d91376c781263" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:21.232033  5139 raft_consensus.cc:3060] T e5b732ffbeea492c9c4d91376c781263 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.234766  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b732ffbeea492c9c4d91376c781263" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:21.235364  5218 raft_consensus.cc:3055] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:21.235603  5218 raft_consensus.cc:740] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:21.236212  5218 consensus_queue.cc:260] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:21.237236  5218 raft_consensus.cc:3060] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.242869  5139 raft_consensus.cc:2468] T e5b732ffbeea492c9c4d91376c781263 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 2.
I20260709 12:26:21.243966  5037 leader_election.cc:304] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:26:21.245026  6383 raft_consensus.cc:2804] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:21.245570  6383 raft_consensus.cc:697] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:21.246487  6383 consensus_queue.cc:237] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:21.250034  6345 raft_consensus.cc:993] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3: : Instructing follower 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:21.250735  6344 raft_consensus.cc:1081] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Signalling peer 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:21.253147  5071 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8da98a042af4ca9ac0ae86911498913"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:36034
I20260709 12:26:21.253716  5071 raft_consensus.cc:493] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:21.254138  5071 raft_consensus.cc:3060] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.261340  5071 raft_consensus.cc:515] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:21.243964  5218 raft_consensus.cc:2468] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 2.
I20260709 12:26:21.264217  5139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8da98a042af4ca9ac0ae86911498913" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:21.264820  5139 raft_consensus.cc:3060] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.268268  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8da98a042af4ca9ac0ae86911498913" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:21.267145  5071 leader_election.cc:290] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:21.269496  5218 raft_consensus.cc:3055] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:21.269897  5218 raft_consensus.cc:740] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:21.270684  5218 consensus_queue.cc:260] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:21.271728  5218 raft_consensus.cc:3060] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.274919  5139 raft_consensus.cc:2468] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 2.
I20260709 12:26:21.277186  5037 leader_election.cc:304] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:26:21.279685  6383 raft_consensus.cc:2804] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:21.280206  6383 raft_consensus.cc:697] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:21.278261  4968 catalog_manager.cc:5697] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 1 to 2, leader changed from 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 2 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:21.282796  6383 consensus_queue.cc:237] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:21.278286  5218 raft_consensus.cc:2468] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 2.
I20260709 12:26:21.301141  4968 catalog_manager.cc:5697] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 1 to 2, leader changed from 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 2 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:21.474645  6236 raft_consensus.cc:993] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb: : Instructing follower 6e72ecbdf12a4160856b2a57422118a3 to start an election
I20260709 12:26:21.475194  6319 raft_consensus.cc:1081] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Signalling peer 6e72ecbdf12a4160856b2a57422118a3 to start an election
I20260709 12:26:21.477000  5218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c83bfe7fc28a4548aa8923c761e8108d"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
 from {username='slave'} at 127.0.0.1:37584
I20260709 12:26:21.477562  5218 raft_consensus.cc:493] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:21.477872  5218 raft_consensus.cc:3060] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.482429  5218 raft_consensus.cc:515] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:21.483932  5218 leader_election.cc:290] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:21.484687  5066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83bfe7fc28a4548aa8923c761e8108d" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:21.485446  5066 raft_consensus.cc:3060] T c83bfe7fc28a4548aa8923c761e8108d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.485345  5139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c83bfe7fc28a4548aa8923c761e8108d" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:21.486215  5139 raft_consensus.cc:3055] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:21.486599  5139 raft_consensus.cc:740] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:26:21.487673  5139 consensus_queue.cc:260] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:21.488904  5139 raft_consensus.cc:3060] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.491086  5066 raft_consensus.cc:2468] T c83bfe7fc28a4548aa8923c761e8108d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 2.
I20260709 12:26:21.492087  5187 leader_election.cc:304] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:26:21.492813  6254 raft_consensus.cc:2804] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:21.493240  6254 raft_consensus.cc:697] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:21.493973  6254 consensus_queue.cc:237] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:21.495594  5139 raft_consensus.cc:2468] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 2.
I20260709 12:26:21.506829  4968 catalog_manager.cc:5697] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 1 to 2, leader changed from d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 2 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:21.666567  5139 raft_consensus.cc:1275] T e5b732ffbeea492c9c4d91376c781263 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:21.667904  6381 consensus_queue.cc:1048] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:21.671099  5094 debug-util.cc:398] Leaking SignalData structure 0x7b08000e49c0 after lost signal to thread 3876
W20260709 12:26:21.672186  5094 debug-util.cc:398] Leaking SignalData structure 0x7b0800170ce0 after lost signal to thread 5005
W20260709 12:26:21.673478  5094 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5b60 after lost signal to thread 5097
W20260709 12:26:21.674588  5094 debug-util.cc:398] Leaking SignalData structure 0x7b08003130c0 after lost signal to thread 5172
W20260709 12:26:21.676476  5094 debug-util.cc:398] Leaking SignalData structure 0x7b080034ec20 after lost signal to thread 5246
W20260709 12:26:21.677753  5094 debug-util.cc:398] Leaking SignalData structure 0x7b08000dac40 after lost signal to thread 5769
I20260709 12:26:21.687703  5147 raft_consensus.cc:1275] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:21.693746  6381 consensus_queue.cc:1048] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:21.705593  5218 raft_consensus.cc:1275] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:21.707214  6231 consensus_queue.cc:1048] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:21.733031  6237 raft_consensus.cc:993] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3: : Instructing follower e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:21.733529  6237 raft_consensus.cc:1081] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Signalling peer e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:21.735070  5744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffee9280ebbb43bf892976cab5021757"
dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:35796
I20260709 12:26:21.735579  5744 raft_consensus.cc:493] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:21.735935  5744 raft_consensus.cc:3060] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.746764  5219 raft_consensus.cc:1275] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:21.752096  6383 consensus_queue.cc:1048] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:21.759368  5744 raft_consensus.cc:515] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:21.762807  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffee9280ebbb43bf892976cab5021757" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:21.763350  5147 raft_consensus.cc:3060] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.770030  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffee9280ebbb43bf892976cab5021757" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:21.770637  5218 raft_consensus.cc:3055] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:21.770900  5218 raft_consensus.cc:740] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:21.771600  5218 consensus_queue.cc:260] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:21.772146  5744 leader_election.cc:290] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:21.772660  5218 raft_consensus.cc:3060] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.776960  5147 raft_consensus.cc:2468] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:21.782106  5709 leader_election.cc:304] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:21.784014  6320 raft_consensus.cc:2804] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:21.784817  6320 raft_consensus.cc:697] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
I20260709 12:26:21.786933  6320 consensus_queue.cc:237] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:21.802250  5218 raft_consensus.cc:2468] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:21.815416  4967 catalog_manager.cc:5697] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 1 to 2, leader changed from 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.095005  5071 raft_consensus.cc:1275] T c83bfe7fc28a4548aa8923c761e8108d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:22.096859  6235 consensus_queue.cc:1048] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:22.139636  5217 consensus_queue.cc:237] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:22.179350  5141 raft_consensus.cc:1275] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:22.183161  6235 consensus_queue.cc:1048] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:22.193769  5186 consensus_peers.cc:597] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a3a3a987e8c145f484b2c0aa9890ed20. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:22.196379  5141 raft_consensus.cc:1275] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:22.196326  5066 raft_consensus.cc:1275] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:22.205996  6254 consensus_queue.cc:1048] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:22.258327  5187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 60099.8us
I20260709 12:26:22.269642  5222 raft_consensus.cc:1275] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:22.270964  6237 consensus_queue.cc:1048] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:26:22.274076  6315 consensus_queue.cc:1048] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:22.276414  6418 raft_consensus.cc:2955] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:22.281770  5141 raft_consensus.cc:2955] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:22.309886  5147 raft_consensus.cc:1275] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:22.311829  6403 consensus_queue.cc:1048] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:22.313171  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:22.352015  5067 consensus_queue.cc:237] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:22.359009  4968 catalog_manager.cc:5697] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:22.384519  5071 raft_consensus.cc:2955] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:22.401990  5217 raft_consensus.cc:1275] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:22.403700  6381 consensus_queue.cc:1048] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:22.422292  5037 consensus_peers.cc:597] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f70fcd244ec422c887a45f476de45f1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:22.427497  5139 raft_consensus.cc:1275] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:22.428920  6381 consensus_queue.cc:1048] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:26:22.480641  6231 raft_consensus.cc:2955] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:22.493175  5147 raft_consensus.cc:2955] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:22.488988  5219 raft_consensus.cc:2955] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:22.527339  4966 catalog_manager.cc:5697] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:22.529489  5066 consensus_queue.cc:237] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:22.557964  5139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bd4cf6677164933b892bc384682a045"
dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
mode: GRACEFUL
new_leader_uuid: "6e72ecbdf12a4160856b2a57422118a3"
 from {username='slave'} at 127.0.0.1:59770
I20260709 12:26:22.558626  5139 raft_consensus.cc:606] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Received request to transfer leadership to TS 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:26:22.561462  5071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89a90aff4ede48ad8c6ef5d2ca6c1a5c"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:22.562047  5071 raft_consensus.cc:606] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Received request to transfer leadership to TS e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:22.572158  5219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f863b6a5fcc24d979cc005aaef6827ae"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
mode: GRACEFUL
new_leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:52694
I20260709 12:26:22.573041  5219 raft_consensus.cc:606] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Received request to transfer leadership to TS 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:26:22.576509  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:22.577105  6235 raft_consensus.cc:993] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3: : Instructing follower 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:22.577553  6235 raft_consensus.cc:1081] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Signalling peer 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:22.578308  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:22.579100  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:22.586252  5067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f863b6a5fcc24d979cc005aaef6827ae"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:36034
I20260709 12:26:22.586947  5067 raft_consensus.cc:493] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:22.587373  5067 raft_consensus.cc:3060] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.596169  5067 raft_consensus.cc:515] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:22.599148  5219 raft_consensus.cc:1275] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:22.600986  6383 consensus_queue.cc:1048] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:22.601462  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863b6a5fcc24d979cc005aaef6827ae" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:22.602033  5219 raft_consensus.cc:3055] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:22.602314  5219 raft_consensus.cc:740] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:22.603078  5219 consensus_queue.cc:260] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:22.604020  5219 raft_consensus.cc:3060] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.604454  5147 raft_consensus.cc:1275] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:22.605255  5037 consensus_peers.cc:597] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7292f06cb5514a80849fe386d1f5edd5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:22.606397  6383 consensus_queue.cc:1048] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:22.613329  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863b6a5fcc24d979cc005aaef6827ae" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
I20260709 12:26:22.613910  5745 raft_consensus.cc:3060] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.630234  5745 raft_consensus.cc:2468] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 2.
I20260709 12:26:22.632972  5067 leader_election.cc:290] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 election: Requested vote from peers 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:22.633440  5037 leader_election.cc:304] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:22.642010  6383 raft_consensus.cc:2804] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:22.642509  6383 raft_consensus.cc:697] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:22.634991  5219 raft_consensus.cc:2468] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 2.
I20260709 12:26:22.647161  6383 consensus_queue.cc:237] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:22.658095  6381 raft_consensus.cc:2955] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:22.663012  5147 raft_consensus.cc:2955] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:22.682839  5222 raft_consensus.cc:2955] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:22.696583  5067 consensus_queue.cc:237] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:22.674548  4966 catalog_manager.cc:5697] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 1 to 2, leader changed from 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 2 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:22.706252  4967 catalog_manager.cc:5697] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
W20260709 12:26:22.711666  5037 consensus_peers.cc:597] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8da98a042af4ca9ac0ae86911498913. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:22.713222  5222 raft_consensus.cc:1275] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:22.713467  5139 raft_consensus.cc:1275] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:22.721450  6381 consensus_queue.cc:1048] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:22.722905  6414 consensus_queue.cc:1048] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:22.744441  6383 raft_consensus.cc:2955] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:22.750530  5222 raft_consensus.cc:2955] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:22.755429  5141 raft_consensus.cc:2955] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:22.778648  4967 catalog_manager.cc:5697] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 2 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:22.786787  6437 ts_tablet_manager.cc:933] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:22.808378  6437 tablet_copy_client.cc:323] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.67:43993
I20260709 12:26:22.810966  5232 tablet_copy_service.cc:140] P 6e72ecbdf12a4160856b2a57422118a3: Received BeginTabletCopySession request for tablet a3a3a987e8c145f484b2c0aa9890ed20 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:34832)
I20260709 12:26:22.811532  5232 tablet_copy_service.cc:161] P 6e72ecbdf12a4160856b2a57422118a3: Beginning new tablet copy session on tablet a3a3a987e8c145f484b2c0aa9890ed20 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:34832: session id = e030bb11bf104d5298a2521f8f7b206b-a3a3a987e8c145f484b2c0aa9890ed20
I20260709 12:26:22.823092  5232 tablet_copy_source_session.cc:215] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:22.827121  6437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3a3a987e8c145f484b2c0aa9890ed20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:22.844215  6437 tablet_copy_client.cc:806] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:22.844919  6437 tablet_copy_client.cc:670] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:22.854594  6437 tablet_copy_client.cc:538] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:22.867374  6437 tablet_bootstrap.cc:492] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:22.892951  6437 tablet_bootstrap.cc:492] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:22.894021  6437 tablet_bootstrap.cc:492] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:22.894814  6437 ts_tablet_manager.cc:1403] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.028s	user 0.027s	sys 0.000s
I20260709 12:26:22.898092  6437 raft_consensus.cc:359] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:22.899080  6437 raft_consensus.cc:740] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:22.899827  6437 consensus_queue.cc:260] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:22.906965  6437 ts_tablet_manager.cc:1434] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:26:22.908602  6319 raft_consensus.cc:993] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb: : Instructing follower 6e72ecbdf12a4160856b2a57422118a3 to start an election
I20260709 12:26:22.909121  6319 raft_consensus.cc:1081] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Signalling peer 6e72ecbdf12a4160856b2a57422118a3 to start an election
I20260709 12:26:22.910166  5232 tablet_copy_service.cc:342] P 6e72ecbdf12a4160856b2a57422118a3: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-a3a3a987e8c145f484b2c0aa9890ed20 received from {username='slave'} at 127.0.0.1:34832
I20260709 12:26:22.910636  5232 tablet_copy_service.cc:434] P 6e72ecbdf12a4160856b2a57422118a3: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-a3a3a987e8c145f484b2c0aa9890ed20 on tablet a3a3a987e8c145f484b2c0aa9890ed20 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:22.918473  5222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bd4cf6677164933b892bc384682a045"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
 from {username='slave'} at 127.0.0.1:37584
I20260709 12:26:22.919039  5222 raft_consensus.cc:493] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:22.919412  5222 raft_consensus.cc:3060] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.932427  5222 raft_consensus.cc:515] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:22.935701  6437 ts_tablet_manager.cc:933] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149)
I20260709 12:26:22.935906  5067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd4cf6677164933b892bc384682a045" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:22.936467  5067 raft_consensus.cc:3060] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.944885  6437 tablet_copy_client.cc:323] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.65:37149
I20260709 12:26:22.947002  5083 tablet_copy_service.cc:140] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Received BeginTabletCopySession request for tablet 3f70fcd244ec422c887a45f476de45f1 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:53396)
I20260709 12:26:22.947341  5222 leader_election.cc:290] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:22.947551  5083 tablet_copy_service.cc:161] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Beginning new tablet copy session on tablet 3f70fcd244ec422c887a45f476de45f1 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:53396: session id = e030bb11bf104d5298a2521f8f7b206b-3f70fcd244ec422c887a45f476de45f1
I20260709 12:26:22.949502  5141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd4cf6677164933b892bc384682a045" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:22.949898  5067 raft_consensus.cc:2468] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 2.
I20260709 12:26:22.950115  5141 raft_consensus.cc:3055] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:22.950525  5141 raft_consensus.cc:740] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:26:22.951161  5187 leader_election.cc:304] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:26:22.951264  5141 consensus_queue.cc:260] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:22.952138  6425 raft_consensus.cc:2804] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:22.952677  6425 raft_consensus.cc:697] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:22.966064  6425 consensus_queue.cc:237] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:22.952768  5141 raft_consensus.cc:3060] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.983664  5083 tablet_copy_source_session.cc:215] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:22.988489  6437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f70fcd244ec422c887a45f476de45f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:22.992652  5141 raft_consensus.cc:2468] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 2.
I20260709 12:26:23.056751  4967 catalog_manager.cc:5697] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 1 to 2, leader changed from d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 2 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:23.063169  6442 ts_tablet_manager.cc:933] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149)
I20260709 12:26:23.064472  6437 tablet_copy_client.cc:806] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:23.077358  6437 tablet_copy_client.cc:670] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:23.081326  6442 tablet_copy_client.cc:323] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.65:37149
I20260709 12:26:23.081943  6437 tablet_copy_client.cc:538] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:23.083240  5083 tablet_copy_service.cc:140] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Received BeginTabletCopySession request for tablet 7292f06cb5514a80849fe386d1f5edd5 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:53396)
I20260709 12:26:23.083841  5083 tablet_copy_service.cc:161] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Beginning new tablet copy session on tablet 7292f06cb5514a80849fe386d1f5edd5 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:53396: session id = e030bb11bf104d5298a2521f8f7b206b-7292f06cb5514a80849fe386d1f5edd5
I20260709 12:26:23.099896  6437 tablet_bootstrap.cc:492] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:23.108350  6231 raft_consensus.cc:993] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82: : Instructing follower e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:23.108876  6231 raft_consensus.cc:1081] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Signalling peer e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:23.109036  5083 tablet_copy_source_session.cc:215] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:23.112522  5745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89a90aff4ede48ad8c6ef5d2ca6c1a5c"
dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:55096
I20260709 12:26:23.113152  5745 raft_consensus.cc:493] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:23.113344  6442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7292f06cb5514a80849fe386d1f5edd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.113531  5745 raft_consensus.cc:3060] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.129684  5745 raft_consensus.cc:515] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:23.139868  5066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a90aff4ede48ad8c6ef5d2ca6c1a5c" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:23.140452  5066 raft_consensus.cc:3055] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.140781  5066 raft_consensus.cc:740] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:23.141456  5066 consensus_queue.cc:260] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:23.142505  5066 raft_consensus.cc:3060] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.157521  6442 tablet_copy_client.cc:806] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:23.158185  6442 tablet_copy_client.cc:670] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:23.163483  6442 tablet_copy_client.cc:538] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:23.163969  5066 raft_consensus.cc:2468] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:23.165899  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a90aff4ede48ad8c6ef5d2ca6c1a5c" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:23.170058  5147 raft_consensus.cc:3060] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.166390  5745 leader_election.cc:290] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:23.179049  5147 raft_consensus.cc:2468] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:23.180186  5710 leader_election.cc:304] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:23.181176  6403 raft_consensus.cc:2804] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:23.181676  6403 raft_consensus.cc:697] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
I20260709 12:26:23.182534  6403 consensus_queue.cc:237] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:23.199414  5745 raft_consensus.cc:1275] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:23.201165  6414 consensus_queue.cc:1048] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:23.219317  4967 catalog_manager.cc:5697] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:23.256610  5222 raft_consensus.cc:1275] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:23.260016  6383 consensus_queue.cc:1048] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:23.263760  6442 tablet_bootstrap.cc:492] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
W20260709 12:26:23.296752  5709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 58139.5us
I20260709 12:26:23.304986  6454 ts_tablet_manager.cc:933] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149)
I20260709 12:26:23.314942  6454 tablet_copy_client.cc:323] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.65:37149
I20260709 12:26:23.317816  5083 tablet_copy_service.cc:140] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Received BeginTabletCopySession request for tablet f8da98a042af4ca9ac0ae86911498913 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:53396)
I20260709 12:26:23.318518  5083 tablet_copy_service.cc:161] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Beginning new tablet copy session on tablet f8da98a042af4ca9ac0ae86911498913 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:53396: session id = e030bb11bf104d5298a2521f8f7b206b-f8da98a042af4ca9ac0ae86911498913
I20260709 12:26:23.351652  5083 tablet_copy_source_session.cc:215] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:23.446197  6454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8da98a042af4ca9ac0ae86911498913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:23.462976  5071 raft_consensus.cc:1275] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.467262  5741 raft_consensus.cc:1217] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:23.492055  5147 raft_consensus.cc:1275] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.497046  6442 tablet_bootstrap.cc:492] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:23.498050  6442 tablet_bootstrap.cc:492] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:23.498785  6442 ts_tablet_manager.cc:1403] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.235s	user 0.019s	sys 0.011s
I20260709 12:26:23.505888  6437 tablet_bootstrap.cc:492] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:23.506943  6437 tablet_bootstrap.cc:492] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:23.527158  6437 ts_tablet_manager.cc:1403] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.409s	user 0.027s	sys 0.003s
I20260709 12:26:23.535374  6461 consensus_queue.cc:1048] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:23.550661  6437 raft_consensus.cc:359] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:23.551769  6437 raft_consensus.cc:740] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:23.561388  6454 tablet_copy_client.cc:806] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:23.585880  6454 tablet_copy_client.cc:670] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:23.595657  6235 consensus_queue.cc:1048] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.596200  6454 tablet_copy_client.cc:538] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:23.564442  6442 raft_consensus.cc:359] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:23.619683  6454 tablet_bootstrap.cc:492] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:23.630290  6442 raft_consensus.cc:740] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:23.631130  6442 consensus_queue.cc:260] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:23.635037  6437 consensus_queue.cc:260] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:23.641342  6442 ts_tablet_manager.cc:1434] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.142s	user 0.009s	sys 0.000s
I20260709 12:26:23.647130  5139 raft_consensus.cc:1275] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:23.653927  6450 consensus_queue.cc:1048] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:23.662328  6437 ts_tablet_manager.cc:1434] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.135s	user 0.008s	sys 0.000s
I20260709 12:26:23.669355  5067 raft_consensus.cc:1275] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:23.670727  6403 consensus_queue.cc:1048] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:23.673611  5083 tablet_copy_service.cc:342] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-7292f06cb5514a80849fe386d1f5edd5 received from {username='slave'} at 127.0.0.1:53396
I20260709 12:26:23.674162  5083 tablet_copy_service.cc:434] P 0aa78544c8fb4f9cbf5ab1a935e18e82: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-7292f06cb5514a80849fe386d1f5edd5 on tablet 7292f06cb5514a80849fe386d1f5edd5 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:23.687997  5083 tablet_copy_service.cc:342] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-3f70fcd244ec422c887a45f476de45f1 received from {username='slave'} at 127.0.0.1:53396
I20260709 12:26:23.688485  5083 tablet_copy_service.cc:434] P 0aa78544c8fb4f9cbf5ab1a935e18e82: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-3f70fcd244ec422c887a45f476de45f1 on tablet 3f70fcd244ec422c887a45f476de45f1 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:23.720043  6454 tablet_bootstrap.cc:492] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:23.724504  6454 tablet_bootstrap.cc:492] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:23.752388  6454 ts_tablet_manager.cc:1403] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.133s	user 0.017s	sys 0.011s
I20260709 12:26:23.775287  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:23.762217  5113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 61818.2us
I20260709 12:26:23.777626  5741 raft_consensus.cc:1217] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:23.816519  6454 raft_consensus.cc:359] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:23.820340  6454 raft_consensus.cc:740] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:23.821147  6454 consensus_queue.cc:260] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:23.843010  6459 raft_consensus.cc:1064] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:23.845558  6459 consensus_queue.cc:237] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:23.848344  6454 ts_tablet_manager.cc:1434] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.000s
I20260709 12:26:23.863225  5083 tablet_copy_service.cc:342] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-f8da98a042af4ca9ac0ae86911498913 received from {username='slave'} at 127.0.0.1:53396
I20260709 12:26:23.863692  5083 tablet_copy_service.cc:434] P 0aa78544c8fb4f9cbf5ab1a935e18e82: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-f8da98a042af4ca9ac0ae86911498913 on tablet f8da98a042af4ca9ac0ae86911498913 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:23.871173  5067 raft_consensus.cc:1275] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:23.872622  6462 consensus_queue.cc:1048] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:23.889605  5147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1838a7c5a8e448ff84f311a659312dff"
dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
mode: GRACEFUL
new_leader_uuid: "6e72ecbdf12a4160856b2a57422118a3"
 from {username='slave'} at 127.0.0.1:59770
I20260709 12:26:23.891386  5147 raft_consensus.cc:606] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Received request to transfer leadership to TS 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:26:23.899900  5741 raft_consensus.cc:1275] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:23.901880  5742 raft_consensus.cc:1217] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:23.906692  5147 raft_consensus.cc:1275] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:23.908452  5219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22a881bcc72945ed82bb9c3b8125ada4"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
mode: GRACEFUL
new_leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:52694
I20260709 12:26:23.909893  5219 raft_consensus.cc:606] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Received request to transfer leadership to TS 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:26:23.912951  5067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c872a85641bb42caaf228b2eeeafcc93"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "d22f4ab7b09f42258209170e7c9214cb"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:23.913540  5067 raft_consensus.cc:606] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Received request to transfer leadership to TS d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:23.922160  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:23.924125  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:23.925302  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:23.930114  6383 raft_consensus.cc:993] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82: : Instructing follower d22f4ab7b09f42258209170e7c9214cb to start an election
I20260709 12:26:23.930670  6383 raft_consensus.cc:1081] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Signalling peer d22f4ab7b09f42258209170e7c9214cb to start an election
I20260709 12:26:23.932799  5139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c872a85641bb42caaf228b2eeeafcc93"
dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
 from {username='slave'} at 127.0.0.1:33564
I20260709 12:26:23.933343  5139 raft_consensus.cc:493] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:23.933682  5139 raft_consensus.cc:3060] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.949828  5139 raft_consensus.cc:515] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:23.957787  6462 consensus_queue.cc:1048] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:23.960867  5067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c872a85641bb42caaf228b2eeeafcc93" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:23.961468  5067 raft_consensus.cc:3055] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.961786  5067 raft_consensus.cc:740] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:23.962057  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c872a85641bb42caaf228b2eeeafcc93" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:23.962607  5219 raft_consensus.cc:3060] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.962533  5067 consensus_queue.cc:260] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:23.963480  5139 leader_election.cc:290] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:23.963716  5067 raft_consensus.cc:3060] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.972139  6459 consensus_queue.cc:1048] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:23.976923  5219 raft_consensus.cc:2468] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 2.
I20260709 12:26:23.978493  5114 leader_election.cc:304] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:26:23.979414  6457 raft_consensus.cc:2804] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:23.979916  6457 raft_consensus.cc:697] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:26:23.980795  6457 consensus_queue.cc:237] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:23.990334  5067 raft_consensus.cc:2468] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 2.
I20260709 12:26:24.017357  4966 catalog_manager.cc:5697] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.030081  6236 raft_consensus.cc:993] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb: : Instructing follower 6e72ecbdf12a4160856b2a57422118a3 to start an election
I20260709 12:26:24.030642  6236 raft_consensus.cc:1081] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Signalling peer 6e72ecbdf12a4160856b2a57422118a3 to start an election
I20260709 12:26:24.032292  6459 raft_consensus.cc:2955] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.036427  5222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1838a7c5a8e448ff84f311a659312dff"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
 from {username='slave'} at 127.0.0.1:37584
I20260709 12:26:24.037024  5222 raft_consensus.cc:493] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.037353  5222 raft_consensus.cc:3060] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.160391  5222 raft_consensus.cc:515] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:24.163029  5222 leader_election.cc:290] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:24.048606  5139 raft_consensus.cc:2955] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.187372  6462 raft_consensus.cc:993] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3: : Instructing follower 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:24.188000  6235 raft_consensus.cc:1081] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Signalling peer 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:24.190356  5071 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22a881bcc72945ed82bb9c3b8125ada4"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:36034
I20260709 12:26:24.190989  5071 raft_consensus.cc:493] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.191406  5071 raft_consensus.cc:3060] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.203944  5071 raft_consensus.cc:515] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:24.216708  5139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a881bcc72945ed82bb9c3b8125ada4" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:24.217320  5139 raft_consensus.cc:3060] T 22a881bcc72945ed82bb9c3b8125ada4 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.216960  5070 raft_consensus.cc:2955] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.222093  5071 leader_election.cc:290] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:24.224742  5139 raft_consensus.cc:2468] T 22a881bcc72945ed82bb9c3b8125ada4 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 2.
I20260709 12:26:24.224903  5219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a881bcc72945ed82bb9c3b8125ada4" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:24.225450  5219 raft_consensus.cc:3055] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.225780  5219 raft_consensus.cc:740] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:24.225996  5037 leader_election.cc:304] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:26:24.226819  6231 raft_consensus.cc:2804] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.227279  6231 raft_consensus.cc:697] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:24.228523  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1838a7c5a8e448ff84f311a659312dff" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:24.229099  5143 raft_consensus.cc:3055] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.229393  5143 raft_consensus.cc:740] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:26:24.228062  6231 consensus_queue.cc:237] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:24.230140  5143 consensus_queue.cc:260] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:24.226476  5219 consensus_queue.cc:260] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:24.231334  5143 raft_consensus.cc:3060] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.231935  5219 raft_consensus.cc:3060] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.238847  5143 raft_consensus.cc:2468] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 2.
I20260709 12:26:24.241117  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1838a7c5a8e448ff84f311a659312dff" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
I20260709 12:26:24.241930  5741 raft_consensus.cc:3060] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.251879  5741 raft_consensus.cc:2468] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 2.
I20260709 12:26:24.238847  5219 raft_consensus.cc:2468] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 2.
I20260709 12:26:24.270092  4968 catalog_manager.cc:5697] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 1 to 2, leader changed from 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 2 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.271076  4967 catalog_manager.cc:5697] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.278191  5186 leader_election.cc:304] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:24.279096  6459 raft_consensus.cc:2804] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.279922  6459 raft_consensus.cc:697] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:24.284185  6459 consensus_queue.cc:237] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:24.306128  6465 raft_consensus.cc:1064] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:24.326511  6231 raft_consensus.cc:1064] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:24.329022  6231 consensus_queue.cc:237] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:24.347407  6465 consensus_queue.cc:237] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:24.334693  5742 raft_consensus.cc:2955] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.401600  5741 raft_consensus.cc:1217] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:26:24.405792  5139 raft_consensus.cc:1275] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:24.407186  5070 raft_consensus.cc:1275] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.402141  5745 raft_consensus.cc:1275] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:24.384521  4966 catalog_manager.cc:5697] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 1 to 2, leader changed from d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 2 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.414605  6489 consensus_queue.cc:1048] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:24.416095  6457 consensus_queue.cc:1048] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.417569  6489 consensus_queue.cc:1048] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:24.419241  5222 raft_consensus.cc:1275] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.422408  6236 consensus_queue.cc:1048] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.456012  5217 consensus_queue.cc:237] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:24.463474  5222 raft_consensus.cc:1275] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:24.483263  5745 raft_consensus.cc:1275] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:24.485548  5139 raft_consensus.cc:1275] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:24.492205  6485 consensus_queue.cc:1048] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:24.496891  6231 raft_consensus.cc:2955] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.505196  5742 raft_consensus.cc:1275] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:24.508646  5147 raft_consensus.cc:1275] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:24.508879  6488 consensus_queue.cc:1048] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:24.515429  6485 consensus_queue.cc:1048] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:24.524623  5139 raft_consensus.cc:2955] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.548189  5219 raft_consensus.cc:1275] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:24.566016  5745 raft_consensus.cc:2955] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.574435  4967 catalog_manager.cc:5697] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.598138  5217 raft_consensus.cc:2955] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.606654  6231 consensus_queue.cc:1048] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:24.615836  6461 consensus_queue.cc:1048] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:24.624730  6459 consensus_queue.cc:1048] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:24.625254  6485 raft_consensus.cc:2955] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.630260  5745 raft_consensus.cc:2955] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.643898  5139 raft_consensus.cc:1275] T 22a881bcc72945ed82bb9c3b8125ada4 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.647017  6488 consensus_queue.cc:1048] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.669240  5147 raft_consensus.cc:2955] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.678877  4967 catalog_manager.cc:5697] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.704413  5218 raft_consensus.cc:1275] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.706907  5070 consensus_queue.cc:237] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:24.709957  5745 raft_consensus.cc:1275] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:24.718588  6481 raft_consensus.cc:2955] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.725170  6461 consensus_queue.cc:1048] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:24.728513  6488 consensus_queue.cc:1048] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.731199  5745 raft_consensus.cc:1275] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:24.732678  5147 raft_consensus.cc:1275] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:24.732816  6231 consensus_queue.cc:1048] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:24.735628  6383 consensus_queue.cc:1048] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:24.740980  6231 raft_consensus.cc:2955] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.749363  5147 raft_consensus.cc:2955] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.747458  5745 raft_consensus.cc:2955] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.767096  4958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a3a3a987e8c145f484b2c0aa9890ed20 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:24.778601  5147 raft_consensus.cc:2955] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.790607  5742 raft_consensus.cc:2955] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.796627  5219 raft_consensus.cc:2955] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.801082  4957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7292f06cb5514a80849fe386d1f5edd5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:24.791936  4967 catalog_manager.cc:5697] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:24.831830  5060 tablet_service.cc:1558] Processing DeleteTablet for tablet a3a3a987e8c145f484b2c0aa9890ed20 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa78544c8fb4f9cbf5ab1a935e18e82 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39330
I20260709 12:26:24.834879  6506 tablet_replica.cc:333] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:24.850530  4968 catalog_manager.cc:5697] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.869837  5147 raft_consensus.cc:1275] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:24.875128  5204 tablet_service.cc:1558] Processing DeleteTablet for tablet 7292f06cb5514a80849fe386d1f5edd5 with delete_type TABLET_DATA_TOMBSTONED (TS 6e72ecbdf12a4160856b2a57422118a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37564
I20260709 12:26:24.877544  6461 consensus_queue.cc:1048] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:24.880071  6506 raft_consensus.cc:2243] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:24.880838  6506 raft_consensus.cc:2272] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:24.884720  6506 ts_tablet_manager.cc:1916] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:24.913374  6485 raft_consensus.cc:1064] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:24.919721  6507 tablet_replica.cc:333] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:24.920964  6507 raft_consensus.cc:2243] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:24.924793  5070 consensus_queue.cc:237] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:24.929381  6485 consensus_queue.cc:237] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:24.934370  5741 raft_consensus.cc:1275] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:24.941154  5219 raft_consensus.cc:1275] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:24.941897  6383 consensus_queue.cc:1048] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:24.943784  6507 raft_consensus.cc:2272] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:24.945784  6506 ts_tablet_manager.cc:1929] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:24.949266  6506 log.cc:1199] T a3a3a987e8c145f484b2c0aa9890ed20 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root/wals/a3a3a987e8c145f484b2c0aa9890ed20
I20260709 12:26:24.951220  6483 consensus_queue.cc:1048] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:24.948858  6507 ts_tablet_manager.cc:1916] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:24.957667  6488 raft_consensus.cc:2955] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.960965  4957 catalog_manager.cc:5028] TS 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): tablet a3a3a987e8c145f484b2c0aa9890ed20 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:24.962708  5742 raft_consensus.cc:2955] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.978363  6507 ts_tablet_manager.cc:1929] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:24.978827  6507 log.cc:1199] T 7292f06cb5514a80849fe386d1f5edd5 P 6e72ecbdf12a4160856b2a57422118a3: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-2-root/wals/7292f06cb5514a80849fe386d1f5edd5
I20260709 12:26:24.982090  5222 raft_consensus.cc:2955] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:24.983305  5147 raft_consensus.cc:1275] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:24.980499  4958 catalog_manager.cc:5028] TS 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): tablet 7292f06cb5514a80849fe386d1f5edd5 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:24.985255  5745 raft_consensus.cc:1275] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:24.989290  5219 raft_consensus.cc:1275] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:24.989933  6483 consensus_queue.cc:1048] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:24.991007  6231 consensus_queue.cc:1048] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:24.991645  4957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3f70fcd244ec422c887a45f476de45f1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:24.997009  6231 consensus_queue.cc:1048] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:25.018700  4967 catalog_manager.cc:5697] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:25.030247  5136 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f70fcd244ec422c887a45f476de45f1 with delete_type TABLET_DATA_TOMBSTONED (TS d22f4ab7b09f42258209170e7c9214cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33554
I20260709 12:26:25.045583  6383 raft_consensus.cc:2955] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:25.054811  5147 raft_consensus.cc:2955] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:25.110306  4966 catalog_manager.cc:5697] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:25.116394  5742 raft_consensus.cc:2955] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:25.121951  6514 tablet_replica.cc:333] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:25.124691  6514 raft_consensus.cc:2243] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.135583  6514 raft_consensus.cc:2272] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.140820  5218 raft_consensus.cc:2955] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:25.162753  6514 ts_tablet_manager.cc:1916] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:25.166307  5071 consensus_queue.cc:237] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:25.174230  5218 raft_consensus.cc:1275] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:25.174399  5741 raft_consensus.cc:1275] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:25.176851  6383 consensus_queue.cc:1048] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:25.184739  6383 consensus_queue.cc:1048] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:25.191818  6514 ts_tablet_manager.cc:1929] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:25.192402  6514 log.cc:1199] T 3f70fcd244ec422c887a45f476de45f1 P d22f4ab7b09f42258209170e7c9214cb: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-1-root/wals/3f70fcd244ec422c887a45f476de45f1
I20260709 12:26:25.194147  4956 catalog_manager.cc:5028] TS d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): tablet 3f70fcd244ec422c887a45f476de45f1 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:25.198187  6231 raft_consensus.cc:2955] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:25.202072  5218 raft_consensus.cc:2955] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:25.216993  4957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f8da98a042af4ca9ac0ae86911498913 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:25.219933  5742 raft_consensus.cc:2955] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
W20260709 12:26:25.236003  5710 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 118518us
I20260709 12:26:25.399647  4968 catalog_manager.cc:5697] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 4 to 5, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New cstate: current_term: 2 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:25.436738  5136 tablet_service.cc:1558] Processing DeleteTablet for tablet f8da98a042af4ca9ac0ae86911498913 with delete_type TABLET_DATA_TOMBSTONED (TS d22f4ab7b09f42258209170e7c9214cb not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33554
I20260709 12:26:25.439253  6514 tablet_replica.cc:333] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:25.442023  6514 raft_consensus.cc:2243] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.443634  6514 raft_consensus.cc:2272] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.451057  6514 ts_tablet_manager.cc:1916] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:25.473197  6514 ts_tablet_manager.cc:1929] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:26:25.473771  6514 log.cc:1199] T f8da98a042af4ca9ac0ae86911498913 P d22f4ab7b09f42258209170e7c9214cb: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-1-root/wals/f8da98a042af4ca9ac0ae86911498913
I20260709 12:26:25.475836  4956 catalog_manager.cc:5028] TS d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): tablet f8da98a042af4ca9ac0ae86911498913 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:25.508951  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:25.585486  5217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bd4cf6677164933b892bc384682a045"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
mode: GRACEFUL
new_leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:52694
I20260709 12:26:25.586328  5217 raft_consensus.cc:606] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Received request to transfer leadership to TS 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:26:25.590989  5143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ebf5bf87e474e0fbdecf20901b28622"
dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
mode: GRACEFUL
new_leader_uuid: "6e72ecbdf12a4160856b2a57422118a3"
 from {username='slave'} at 127.0.0.1:59770
I20260709 12:26:25.591636  5143 raft_consensus.cc:606] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Received request to transfer leadership to TS 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:26:25.594627  5067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56941204ae3e40bba5254fad3092ebeb"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:25.595182  5067 raft_consensus.cc:606] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Received request to transfer leadership to TS e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:25.596722  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:25.598639  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:25.600090  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:25.625314  6483 raft_consensus.cc:993] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82: : Instructing follower e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:25.625962  6483 raft_consensus.cc:1081] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Signalling peer e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:25.629609  5742 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56941204ae3e40bba5254fad3092ebeb"
dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:55096
I20260709 12:26:25.630611  5742 raft_consensus.cc:493] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:25.631214  5742 raft_consensus.cc:3060] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.650072  5742 raft_consensus.cc:515] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:25.654871  5067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56941204ae3e40bba5254fad3092ebeb" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:25.655714  5067 raft_consensus.cc:3055] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.656065  5067 raft_consensus.cc:740] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:25.660182  5067 consensus_queue.cc:260] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:25.661554  5067 raft_consensus.cc:3060] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.670452  5067 raft_consensus.cc:2468] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:25.671757  5710 leader_election.cc:304] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:25.671865  5742 leader_election.cc:290] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:25.672693  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56941204ae3e40bba5254fad3092ebeb" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:25.672924  6450 raft_consensus.cc:2804] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:25.673929  5143 raft_consensus.cc:3060] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.674790  6450 raft_consensus.cc:697] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
I20260709 12:26:25.675901  6450 consensus_queue.cc:237] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:25.688217  5143 raft_consensus.cc:2468] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:25.864142  4966 catalog_manager.cc:5697] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:25.919615  6347 raft_consensus.cc:993] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb: : Instructing follower 6e72ecbdf12a4160856b2a57422118a3 to start an election
I20260709 12:26:25.920176  6497 raft_consensus.cc:1081] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Signalling peer 6e72ecbdf12a4160856b2a57422118a3 to start an election
I20260709 12:26:25.922031  5217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ebf5bf87e474e0fbdecf20901b28622"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
 from {username='slave'} at 127.0.0.1:37584
I20260709 12:26:25.922612  5217 raft_consensus.cc:493] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:25.922953  5217 raft_consensus.cc:3060] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.930097  5217 raft_consensus.cc:515] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:25.932032  5217 leader_election.cc:290] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:25.934370  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebf5bf87e474e0fbdecf20901b28622" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:25.934979  5745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebf5bf87e474e0fbdecf20901b28622" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
I20260709 12:26:25.935029  5147 raft_consensus.cc:3055] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:25.935595  5147 raft_consensus.cc:740] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:26:25.935607  5745 raft_consensus.cc:3060] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.936728  5147 consensus_queue.cc:260] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:25.938156  5147 raft_consensus.cc:3060] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.943219  5745 raft_consensus.cc:2468] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 3.
I20260709 12:26:25.946264  5147 raft_consensus.cc:2468] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 3.
I20260709 12:26:25.947491  5186 leader_election.cc:304] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:25.948511  6462 raft_consensus.cc:2804] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:25.948984  6462 raft_consensus.cc:697] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:25.949878  6462 consensus_queue.cc:237] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:25.961611  4966 catalog_manager.cc:5697] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 2 to 3, leader changed from d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 3 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:25.997251  6462 raft_consensus.cc:993] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3: : Instructing follower 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:25.997745  6521 raft_consensus.cc:1081] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Signalling peer 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:25.999583  5067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bd4cf6677164933b892bc384682a045"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:36034
I20260709 12:26:26.000247  5067 raft_consensus.cc:493] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:26.000720  5067 raft_consensus.cc:3060] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.008913  5067 raft_consensus.cc:515] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:26.011617  5067 leader_election.cc:290] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 3 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:26.011809  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd4cf6677164933b892bc384682a045" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:26.012449  5143 raft_consensus.cc:3060] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.013216  5217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd4cf6677164933b892bc384682a045" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:26.013778  5217 raft_consensus.cc:3055] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:26.014057  5217 raft_consensus.cc:740] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:26.014879  5217 consensus_queue.cc:260] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:26.016001  5217 raft_consensus.cc:3060] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.019881  5143 raft_consensus.cc:2468] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 3.
I20260709 12:26:26.021585  5037 leader_election.cc:304] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:26:26.022595  6383 raft_consensus.cc:2804] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:26.022909  5217 raft_consensus.cc:2468] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 3.
I20260709 12:26:26.023090  6383 raft_consensus.cc:697] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:26.023978  6383 consensus_queue.cc:237] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:26.039085  4966 catalog_manager.cc:5697] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 2 to 3, leader changed from 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 3 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.117668  5147 raft_consensus.cc:1275] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:26.119117  6516 consensus_queue.cc:1048] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:26.137934  5067 raft_consensus.cc:1275] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:26.143761  6447 consensus_queue.cc:1048] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:26.433398  5222 raft_consensus.cc:1275] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:26.434572  6488 consensus_queue.cc:1048] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:26.454574  5139 raft_consensus.cc:1275] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:26.456209  6383 consensus_queue.cc:1048] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:26.476449  5139 raft_consensus.cc:1275] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:26.478390  6462 consensus_queue.cc:1048] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:26.503685  5745 raft_consensus.cc:1275] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:26.505376  6521 consensus_queue.cc:1048] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:26.574981  5139 consensus_queue.cc:237] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
W20260709 12:26:26.582815  5112 consensus_peers.cc:597] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c872a85641bb42caaf228b2eeeafcc93. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:26.583750  5217 raft_consensus.cc:1275] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:26.586915  5067 raft_consensus.cc:1275] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:26.587311  6517 consensus_queue.cc:1048] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:26.588996  6497 consensus_queue.cc:1048] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:26.599720  6517 raft_consensus.cc:2955] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:26.603710  5217 raft_consensus.cc:2955] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:26.608201  5071 raft_consensus.cc:2955] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:26.617075  5067 consensus_queue.cc:237] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:26.624385  4966 catalog_manager.cc:5697] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.664950  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:26.682052  5037 consensus_peers.cc:597] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d4c6522d7db94a48b906c63f7c31b8e6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:26.683660  5139 raft_consensus.cc:1275] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:26.685932  6488 consensus_queue.cc:1048] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.688542  5217 raft_consensus.cc:1275] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:26.695082  6488 consensus_queue.cc:1048] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:26.726233  6383 raft_consensus.cc:2955] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:26.746402  5222 raft_consensus.cc:2955] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:26.758471  5143 consensus_queue.cc:237] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
W20260709 12:26:26.776523  5112 consensus_peers.cc:597] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f424fe8428004213860887c1e4ed5796. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:26.778800  5217 raft_consensus.cc:1275] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:26.779127  5067 raft_consensus.cc:1275] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:26.780709  6497 consensus_queue.cc:1048] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.781872  6517 consensus_queue.cc:1048] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.783631  5217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02feac6bfeab4925b7a3a954250788e4"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
mode: GRACEFUL
new_leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:52694
I20260709 12:26:26.784224  5217 raft_consensus.cc:606] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Received request to transfer leadership to TS 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:26:26.799149  5071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "253cc4e85c5b4c18ac746b32b0a47e47"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "d22f4ab7b09f42258209170e7c9214cb"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:26.799919  5071 raft_consensus.cc:606] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Received request to transfer leadership to TS d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:26.801530  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:26.803172  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:26.803933  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:26.841061  6347 raft_consensus.cc:2955] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:26.863822  4966 catalog_manager.cc:5697] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
W20260709 12:26:26.866283  5039 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 77070.6us
I20260709 12:26:26.865036  5222 raft_consensus.cc:2955] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:26.876965  5143 consensus_queue.cc:237] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
W20260709 12:26:26.885424  5037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 98672.1us
I20260709 12:26:26.887452  6545 raft_consensus.cc:993] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82: : Instructing follower d22f4ab7b09f42258209170e7c9214cb to start an election
I20260709 12:26:26.888214  6488 raft_consensus.cc:1081] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Signalling peer d22f4ab7b09f42258209170e7c9214cb to start an election
I20260709 12:26:26.892491  5147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "253cc4e85c5b4c18ac746b32b0a47e47"
dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
 from {username='slave'} at 127.0.0.1:33564
I20260709 12:26:26.893139  5147 raft_consensus.cc:493] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:26.893503  5147 raft_consensus.cc:3060] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.891621  5139 raft_consensus.cc:2955] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:26.955039  4967 catalog_manager.cc:5697] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.957720  5147 raft_consensus.cc:515] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:26.963886  5147 leader_election.cc:290] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:26.976905  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253cc4e85c5b4c18ac746b32b0a47e47" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:26.977662  5218 raft_consensus.cc:3060] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:26.987107  5112 consensus_peers.cc:597] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f147c4f5ae9479dae2779366c7cf2fe. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:26.998143  5218 raft_consensus.cc:2468] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 2.
I20260709 12:26:27.013899  5222 raft_consensus.cc:1275] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:27.018005  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253cc4e85c5b4c18ac746b32b0a47e47" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:27.025388  5070 raft_consensus.cc:3055] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:27.026584  6347 consensus_queue.cc:1048] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.025825  5070 raft_consensus.cc:740] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:27.048254  5114 leader_election.cc:304] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:26:27.087633  5070 consensus_queue.cc:260] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:27.094278  5067 raft_consensus.cc:1275] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:27.097790  6347 raft_consensus.cc:2804] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:26:27.097694  5114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 49648.4us
I20260709 12:26:27.098706  6347 raft_consensus.cc:697] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:26:27.110450  5070 raft_consensus.cc:3060] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.112511  6347 consensus_queue.cc:237] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
W20260709 12:26:27.146040  5037 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 65219.3us
I20260709 12:26:27.150214  5067 raft_consensus.cc:2955] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:27.160837  6517 consensus_queue.cc:1048] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:26:27.174877  5070 raft_consensus.cc:2468] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 2.
W20260709 12:26:27.175796  5039 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 126218us
I20260709 12:26:27.183674  6560 ts_tablet_manager.cc:933] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:26:27.203198  5113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 49123.1us
I20260709 12:26:27.211958  6560 tablet_copy_client.cc:323] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.66:37067
I20260709 12:26:27.226007  6555 raft_consensus.cc:993] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3: : Instructing follower 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:27.226485  6555 raft_consensus.cc:1081] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Signalling peer 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:27.238986  5158 tablet_copy_service.cc:140] P d22f4ab7b09f42258209170e7c9214cb: Received BeginTabletCopySession request for tablet c872a85641bb42caaf228b2eeeafcc93 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:42108)
I20260709 12:26:27.238669  4968 catalog_manager.cc:5697] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:27.239598  5158 tablet_copy_service.cc:161] P d22f4ab7b09f42258209170e7c9214cb: Beginning new tablet copy session on tablet c872a85641bb42caaf228b2eeeafcc93 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:42108: session id = e030bb11bf104d5298a2521f8f7b206b-c872a85641bb42caaf228b2eeeafcc93
I20260709 12:26:27.239733  6497 raft_consensus.cc:2955] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:27.248196  5222 raft_consensus.cc:2955] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:27.261092  5067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02feac6bfeab4925b7a3a954250788e4"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:36034
I20260709 12:26:27.261772  5067 raft_consensus.cc:493] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:27.262264  5067 raft_consensus.cc:3060] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.289889  5158 tablet_copy_source_session.cc:215] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:27.271308  6569 ts_tablet_manager.cc:933] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149)
I20260709 12:26:27.292953  5067 raft_consensus.cc:515] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:27.297159  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02feac6bfeab4925b7a3a954250788e4" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:27.297760  5143 raft_consensus.cc:3060] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.297302  5067 leader_election.cc:290] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:27.305807  5143 raft_consensus.cc:2468] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 2.
I20260709 12:26:27.305912  4967 catalog_manager.cc:5697] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:27.325883  5037 leader_election.cc:304] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:26:27.314301  6560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c872a85641bb42caaf228b2eeeafcc93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.327132  5066 raft_consensus.cc:2955] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:27.334069  6561 raft_consensus.cc:2804] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:27.339780  6561 raft_consensus.cc:697] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:27.353549  6561 consensus_queue.cc:237] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:27.369797  6569 tablet_copy_client.cc:323] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.65:37149
I20260709 12:26:27.376369  5083 tablet_copy_service.cc:140] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Received BeginTabletCopySession request for tablet d4c6522d7db94a48b906c63f7c31b8e6 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:53396)
I20260709 12:26:27.376962  5083 tablet_copy_service.cc:161] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Beginning new tablet copy session on tablet d4c6522d7db94a48b906c63f7c31b8e6 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:53396: session id = e030bb11bf104d5298a2521f8f7b206b-d4c6522d7db94a48b906c63f7c31b8e6
I20260709 12:26:27.370851  6573 ts_tablet_manager.cc:933] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:27.373523  5222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02feac6bfeab4925b7a3a954250788e4" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:27.387508  5222 raft_consensus.cc:3055] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:27.387930  5222 raft_consensus.cc:740] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:27.385388  5083 tablet_copy_source_session.cc:215] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:27.392017  6560 tablet_copy_client.cc:806] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:27.392757  6560 tablet_copy_client.cc:670] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:27.398945  6569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4c6522d7db94a48b906c63f7c31b8e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.400586  6573 tablet_copy_client.cc:323] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.66:37067
I20260709 12:26:27.402509  5158 tablet_copy_service.cc:140] P d22f4ab7b09f42258209170e7c9214cb: Received BeginTabletCopySession request for tablet f424fe8428004213860887c1e4ed5796 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:42108)
I20260709 12:26:27.403162  5158 tablet_copy_service.cc:161] P d22f4ab7b09f42258209170e7c9214cb: Beginning new tablet copy session on tablet f424fe8428004213860887c1e4ed5796 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:42108: session id = e030bb11bf104d5298a2521f8f7b206b-f424fe8428004213860887c1e4ed5796
I20260709 12:26:27.392779  5222 consensus_queue.cc:260] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:27.405506  5222 raft_consensus.cc:3060] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.412115  5158 tablet_copy_source_session.cc:215] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:27.412650  6560 tablet_copy_client.cc:538] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:27.416111  6573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f424fe8428004213860887c1e4ed5796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.437215  4968 catalog_manager.cc:5697] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 1 to 2, leader changed from 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 2 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:27.441617  5222 raft_consensus.cc:2468] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 2.
I20260709 12:26:27.442905  6569 tablet_copy_client.cc:806] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:27.443539  6569 tablet_copy_client.cc:670] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:27.450064  6569 tablet_copy_client.cc:538] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:27.450465  6560 tablet_bootstrap.cc:492] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:27.465440  6569 tablet_bootstrap.cc:492] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:27.466424  6576 ts_tablet_manager.cc:933] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:27.489320  6573 tablet_copy_client.cc:806] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:27.490312  6573 tablet_copy_client.cc:670] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:27.496754  6576 tablet_copy_client.cc:323] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.66:37067
I20260709 12:26:27.498435  6573 tablet_copy_client.cc:538] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:27.498495  5158 tablet_copy_service.cc:140] P d22f4ab7b09f42258209170e7c9214cb: Received BeginTabletCopySession request for tablet 2f147c4f5ae9479dae2779366c7cf2fe from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:42108)
I20260709 12:26:27.499127  5158 tablet_copy_service.cc:161] P d22f4ab7b09f42258209170e7c9214cb: Beginning new tablet copy session on tablet 2f147c4f5ae9479dae2779366c7cf2fe from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:42108: session id = e030bb11bf104d5298a2521f8f7b206b-2f147c4f5ae9479dae2779366c7cf2fe
I20260709 12:26:27.516394  5158 tablet_copy_source_session.cc:215] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:27.521907  6576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f147c4f5ae9479dae2779366c7cf2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.525658  6573 tablet_bootstrap.cc:492] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:27.539884  5070 raft_consensus.cc:1275] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:27.542160  6571 consensus_queue.cc:1048] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:27.552793  5222 raft_consensus.cc:1275] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:27.554998  6566 consensus_queue.cc:1048] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:27.561348  6560 tablet_bootstrap.cc:492] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:27.563856  6560 tablet_bootstrap.cc:492] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:27.565981  6560 ts_tablet_manager.cc:1403] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.116s	user 0.043s	sys 0.015s
I20260709 12:26:27.595561  6576 tablet_copy_client.cc:806] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:27.596155  6576 tablet_copy_client.cc:670] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:27.602205  6569 tablet_bootstrap.cc:492] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:27.603188  6569 tablet_bootstrap.cc:492] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:27.603866  6569 ts_tablet_manager.cc:1403] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.139s	user 0.016s	sys 0.012s
I20260709 12:26:27.624367  6576 tablet_copy_client.cc:538] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:27.658932  6560 raft_consensus.cc:359] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:27.659893  6560 raft_consensus.cc:740] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:27.700260  6573 tablet_bootstrap.cc:492] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:27.707854  6573 tablet_bootstrap.cc:492] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:27.708844  6573 ts_tablet_manager.cc:1403] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.183s	user 0.019s	sys 0.024s
I20260709 12:26:27.715348  6569 raft_consensus.cc:359] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:27.716238  6569 raft_consensus.cc:740] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:27.722318  6573 raft_consensus.cc:359] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:27.723274  6573 raft_consensus.cc:740] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:27.723961  6573 consensus_queue.cc:260] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:27.727494  6573 ts_tablet_manager.cc:1434] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:26:27.752082  6560 consensus_queue.cc:260] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:27.757181  6569 consensus_queue.cc:260] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:27.760810  6576 tablet_bootstrap.cc:492] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:27.763365  6560 ts_tablet_manager.cc:1434] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.196s	user 0.007s	sys 0.000s
I20260709 12:26:27.770295  6569 ts_tablet_manager.cc:1434] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.166s	user 0.011s	sys 0.000s
I20260709 12:26:27.810287  6576 tablet_bootstrap.cc:492] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:27.811398  6576 tablet_bootstrap.cc:492] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:27.812136  6576 ts_tablet_manager.cc:1403] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.012s
I20260709 12:26:27.814762  6576 raft_consensus.cc:359] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:27.815745  6576 raft_consensus.cc:740] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:27.816594  6576 consensus_queue.cc:260] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:27.818941  6576 ts_tablet_manager.cc:1434] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:27.862483  5222 raft_consensus.cc:1275] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:27.864018  6563 consensus_queue.cc:1048] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.867738  5140 raft_consensus.cc:1275] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:27.875025  6545 consensus_queue.cc:1048] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.878367  5744 raft_consensus.cc:1217] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:27.879365  5157 tablet_copy_service.cc:342] P d22f4ab7b09f42258209170e7c9214cb: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-c872a85641bb42caaf228b2eeeafcc93 received from {username='slave'} at 127.0.0.1:42108
I20260709 12:26:27.879890  5157 tablet_copy_service.cc:434] P d22f4ab7b09f42258209170e7c9214cb: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-c872a85641bb42caaf228b2eeeafcc93 on tablet c872a85641bb42caaf228b2eeeafcc93 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:27.983264  5156 tablet_copy_service.cc:342] P d22f4ab7b09f42258209170e7c9214cb: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-2f147c4f5ae9479dae2779366c7cf2fe received from {username='slave'} at 127.0.0.1:42108
I20260709 12:26:27.983711  5156 tablet_copy_service.cc:434] P d22f4ab7b09f42258209170e7c9214cb: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-2f147c4f5ae9479dae2779366c7cf2fe on tablet 2f147c4f5ae9479dae2779366c7cf2fe with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:27.985483  5083 tablet_copy_service.cc:342] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-d4c6522d7db94a48b906c63f7c31b8e6 received from {username='slave'} at 127.0.0.1:53396
I20260709 12:26:27.986016  5083 tablet_copy_service.cc:434] P 0aa78544c8fb4f9cbf5ab1a935e18e82: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-d4c6522d7db94a48b906c63f7c31b8e6 on tablet d4c6522d7db94a48b906c63f7c31b8e6 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:28.098977  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:28.266633  5741 raft_consensus.cc:1217] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:28.301630  5158 tablet_copy_service.cc:342] P d22f4ab7b09f42258209170e7c9214cb: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-f424fe8428004213860887c1e4ed5796 received from {username='slave'} at 127.0.0.1:42108
I20260709 12:26:28.302162  5158 tablet_copy_service.cc:434] P d22f4ab7b09f42258209170e7c9214cb: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-f424fe8428004213860887c1e4ed5796 on tablet f424fe8428004213860887c1e4ed5796 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:28.364037  5744 raft_consensus.cc:1217] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:26:28.398187  5187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 49930.2us
I20260709 12:26:28.417239  5743 raft_consensus.cc:1217] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
W20260709 12:26:28.468676  5113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 518520us
I20260709 12:26:28.541497  6497 raft_consensus.cc:1064] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:28.544695  6497 consensus_queue.cc:237] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:28.562680  5745 raft_consensus.cc:1275] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:28.564481  6594 consensus_queue.cc:1048] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:28.574314  5222 raft_consensus.cc:1275] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:28.576725  6497 consensus_queue.cc:1048] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:28.580986  5070 raft_consensus.cc:1275] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:28.590200  6595 consensus_queue.cc:1048] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:28.610451  6595 raft_consensus.cc:2955] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:28.612643  5215 raft_consensus.cc:2955] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:28.630057  5144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5afebfa702646d8b7372e8562e97d71"
dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
mode: GRACEFUL
new_leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:59770
I20260709 12:26:28.630671  5144 raft_consensus.cc:606] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Received request to transfer leadership to TS 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:26:28.633314  5070 raft_consensus.cc:2955] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:28.633721  4968 catalog_manager.cc:5697] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:28.640718  5066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d650634415db46289a46381b54dde329"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "6e72ecbdf12a4160856b2a57422118a3"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:28.641395  5066 raft_consensus.cc:606] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Received request to transfer leadership to TS 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:26:28.642938  5745 raft_consensus.cc:2955] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:28.653576  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:28.656917  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:28.680652  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:28.712029  5144 consensus_queue.cc:237] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:28.730554  5067 raft_consensus.cc:1275] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:28.733754  6595 consensus_queue.cc:1048] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:28.763708  6497 raft_consensus.cc:2955] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:28.768977  6548 raft_consensus.cc:1064] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:28.771842  6548 consensus_queue.cc:237] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:28.782684  5066 raft_consensus.cc:2955] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:28.796913  5745 raft_consensus.cc:1275] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:28.802083  6595 consensus_queue.cc:1048] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:28.804080  4956 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f424fe8428004213860887c1e4ed5796 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:28.819706  4970 catalog_manager.cc:5697] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.883929  5745 raft_consensus.cc:2955] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:28.900786  5204 tablet_service.cc:1558] Processing DeleteTablet for tablet f424fe8428004213860887c1e4ed5796 with delete_type TABLET_DATA_TOMBSTONED (TS 6e72ecbdf12a4160856b2a57422118a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37564
I20260709 12:26:28.930794  6613 tablet_replica.cc:333] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:28.932121  6613 raft_consensus.cc:2243] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:28.932910  6613 raft_consensus.cc:2272] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:28.937959  5169 debug-util.cc:398] Leaking SignalData structure 0x7b08001e80e0 after lost signal to thread 3876
W20260709 12:26:28.940060  5169 debug-util.cc:398] Leaking SignalData structure 0x7b080016a360 after lost signal to thread 5005
W20260709 12:26:28.941368  5169 debug-util.cc:398] Leaking SignalData structure 0x7b0800321260 after lost signal to thread 5097
W20260709 12:26:28.942497  5169 debug-util.cc:398] Leaking SignalData structure 0x7b08001915c0 after lost signal to thread 5172
W20260709 12:26:28.943722  5169 debug-util.cc:398] Leaking SignalData structure 0x7b0800332d00 after lost signal to thread 5246
W20260709 12:26:28.946241  5169 debug-util.cc:398] Leaking SignalData structure 0x7b0800054da0 after lost signal to thread 5769
I20260709 12:26:28.955101  6613 ts_tablet_manager.cc:1916] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:29.023921  6561 raft_consensus.cc:993] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82: : Instructing follower 6e72ecbdf12a4160856b2a57422118a3 to start an election
I20260709 12:26:29.024483  6561 raft_consensus.cc:1081] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Signalling peer 6e72ecbdf12a4160856b2a57422118a3 to start an election
I20260709 12:26:29.031246  5218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d650634415db46289a46381b54dde329"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
 from {username='slave'} at 127.0.0.1:37568
I20260709 12:26:29.031984  5218 raft_consensus.cc:493] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:29.032456  5218 raft_consensus.cc:3060] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:29.050384  6571 raft_consensus.cc:1064] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:29.053128  5215 raft_consensus.cc:1275] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:29.058447  6597 raft_consensus.cc:1064] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:29.061672  6571 consensus_queue.cc:237] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:29.060303  6595 raft_consensus.cc:993] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb: : Instructing follower 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:29.063117  6497 raft_consensus.cc:1081] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Signalling peer 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:29.067202  6613 ts_tablet_manager.cc:1929] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:29.070120  5218 raft_consensus.cc:515] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:29.080236  6563 consensus_queue.cc:1048] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:29.083371  6597 consensus_queue.cc:237] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:29.073791  6613 log.cc:1199] T f424fe8428004213860887c1e4ed5796 P 6e72ecbdf12a4160856b2a57422118a3: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-2-root/wals/f424fe8428004213860887c1e4ed5796
I20260709 12:26:29.089251  5218 leader_election.cc:290] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:29.090591  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650634415db46289a46381b54dde329" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:29.108536  5070 raft_consensus.cc:3055] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:29.108892  5070 raft_consensus.cc:740] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:29.109611  5070 consensus_queue.cc:260] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:29.110697  5070 raft_consensus.cc:3060] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:29.091432  4958 catalog_manager.cc:5028] TS 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): tablet f424fe8428004213860887c1e4ed5796 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:29.091958  5144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d650634415db46289a46381b54dde329" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:29.116912  5144 raft_consensus.cc:3060] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:29.118847  5070 raft_consensus.cc:2468] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 3.
I20260709 12:26:29.121086  5187 leader_election.cc:304] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:26:29.099007  5140 raft_consensus.cc:1275] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:29.099603  5741 raft_consensus.cc:1275] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:29.107935  5067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5afebfa702646d8b7372e8562e97d71"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:39340
I20260709 12:26:29.122818  5067 raft_consensus.cc:493] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:29.123184  5067 raft_consensus.cc:3060] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:29.123337  6554 raft_consensus.cc:2804] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:29.123859  6554 raft_consensus.cc:697] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:29.124796  6554 consensus_queue.cc:237] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:29.133563  6617 consensus_queue.cc:1048] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:29.133185  5144 raft_consensus.cc:2468] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 3.
I20260709 12:26:29.140547  5741 raft_consensus.cc:1275] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:29.142436  6497 consensus_queue.cc:1048] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:29.135885  6617 consensus_queue.cc:1048] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:29.159461  5067 raft_consensus.cc:515] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:29.161962  5067 leader_election.cc:290] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 3 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:29.165740  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5afebfa702646d8b7372e8562e97d71" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:29.166469  5218 raft_consensus.cc:3060] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:29.175755  5147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5afebfa702646d8b7372e8562e97d71" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:29.176601  5147 raft_consensus.cc:3055] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:29.176977  5147 raft_consensus.cc:740] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:26:29.177752  5147 consensus_queue.cc:260] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:29.191105  5066 raft_consensus.cc:1275] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:29.203075  5147 raft_consensus.cc:3060] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:29.202783  5218 raft_consensus.cc:2468] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 3.
I20260709 12:26:29.206682  5039 leader_election.cc:304] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:26:29.204627  6598 consensus_queue.cc:1048] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:26:29.228457  5147 raft_consensus.cc:2468] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 3.
I20260709 12:26:29.216490  6619 raft_consensus.cc:2804] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:26:29.235322  6622 log.cc:927] Time spent T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 12:26:29.237926  6623 log.cc:927] Time spent T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:26:29.238029  6619 raft_consensus.cc:697] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:29.239223  6619 consensus_queue.cc:237] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:29.235757  5215 raft_consensus.cc:1275] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:29.244599  5216 raft_consensus.cc:1275] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:29.245517  6594 consensus_queue.cc:1048] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:29.248654  5745 raft_consensus.cc:1275] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:29.253046  6550 consensus_queue.cc:1048] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:29.233865  4966 catalog_manager.cc:5697] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 2 to 3, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 3 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:29.277415  6617 raft_consensus.cc:2955] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:29.286099  5066 raft_consensus.cc:1275] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:29.285431  5143 raft_consensus.cc:2955] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:29.309615  6497 consensus_queue.cc:1048] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:26:29.322964  6595 consensus_queue.cc:1048] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:26:29.399376  6606 log.cc:927] Time spent T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:26:29.399730  5711 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 55164.6us
W20260709 12:26:29.457450  5709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 168008us
W20260709 12:26:29.504477  5112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:43655, user_credentials={real_user=slave}} blocked reactor thread for 110863us
I20260709 12:26:29.500735  5741 raft_consensus.cc:2955] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
W20260709 12:26:29.583143  5113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 45331us
I20260709 12:26:29.587568  5070 raft_consensus.cc:2955] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
W20260709 12:26:29.595709  5709 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 56365.6us
W20260709 12:26:29.599490  5112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:43655, user_credentials={real_user=slave}} blocked reactor thread for 64371.8us
I20260709 12:26:29.614562  6637 raft_consensus.cc:2955] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:29.639647  4970 catalog_manager.cc:5697] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 2 to 3, leader changed from d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 3 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:29.651984  4968 catalog_manager.cc:5697] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:29.675710  5066 raft_consensus.cc:1275] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:26:29.684962  5710 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 156395us
I20260709 12:26:29.697732  5745 raft_consensus.cc:2955] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:29.684515  5216 raft_consensus.cc:2955] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:29.700794  6614 consensus_queue.cc:1048] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:26:29.715169  5739 raft_consensus.cc:2955] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:29.720220  5215 raft_consensus.cc:2955] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:29.777163  6598 raft_consensus.cc:2955] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
W20260709 12:26:29.779656  5187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 82995.2us
I20260709 12:26:29.810662  5070 raft_consensus.cc:2955] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:29.851117  5144 raft_consensus.cc:1275] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:29.879908  5215 raft_consensus.cc:2955] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:29.888685  6555 consensus_queue.cc:1048] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:29.913902  5216 raft_consensus.cc:1275] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:29.942142  5144 raft_consensus.cc:1275] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:29.945632  6563 consensus_queue.cc:1048] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:29.945706  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:29.953101  4970 catalog_manager.cc:5697] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:29.982441  6610 consensus_queue.cc:1048] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:29.990919  4967 catalog_manager.cc:5697] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:30.054617  5066 consensus_queue.cc:237] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:30.076944  5221 raft_consensus.cc:1275] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:30.078409  5739 raft_consensus.cc:1275] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:30.078569  6610 consensus_queue.cc:1048] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:30.083521  5139 consensus_queue.cc:237] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:30.084208  6618 consensus_queue.cc:1048] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:26:30.088333  5144 consensus_queue.cc:237] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:30.094291  5741 raft_consensus.cc:1275] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:30.097981  6644 consensus_queue.cc:1048] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:30.101101  6590 raft_consensus.cc:2955] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:30.114588  6615 raft_consensus.cc:2955] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:30.119990  5741 raft_consensus.cc:2955] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:30.110495  5221 raft_consensus.cc:2955] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:30.137517  5740 raft_consensus.cc:1275] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:30.140888  5216 raft_consensus.cc:1275] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:30.143015  5215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a00dc8dae764febafe0efdc0fadcdac"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
mode: GRACEFUL
new_leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:52694
I20260709 12:26:30.143631  5215 raft_consensus.cc:606] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Received request to transfer leadership to TS 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:26:30.145798  5216 raft_consensus.cc:1275] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:30.149878  5070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f70fcd244ec422c887a45f476de45f1"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:30.150511  5070 raft_consensus.cc:606] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Received request to transfer leadership to TS e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:30.151186  6598 consensus_queue.cc:1048] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:30.149848  4970 catalog_manager.cc:5697] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 4 to 5, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:30.157266  6598 consensus_queue.cc:1048] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:30.164474  5070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdc3c77d7a1a4a4c9cf2c6405234815d"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "d22f4ab7b09f42258209170e7c9214cb"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:30.173494  5070 raft_consensus.cc:606] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Received request to transfer leadership to TS d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:30.182281  4957 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d4c6522d7db94a48b906c63f7c31b8e6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:30.160276  6649 consensus_queue.cc:1048] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:26:30.185870  6637 raft_consensus.cc:2955] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:30.191426  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:30.193001  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:30.196913  5741 raft_consensus.cc:2955] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:30.208091  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:30.198159  5221 raft_consensus.cc:2955] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:30.211086  4967 catalog_manager.cc:5697] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:30.128934  5739 raft_consensus.cc:2955] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:30.256695  4956 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c872a85641bb42caaf228b2eeeafcc93 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:30.265350  4956 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2f147c4f5ae9479dae2779366c7cf2fe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:30.296038  5136 tablet_service.cc:1558] Processing DeleteTablet for tablet d4c6522d7db94a48b906c63f7c31b8e6 with delete_type TABLET_DATA_TOMBSTONED (TS d22f4ab7b09f42258209170e7c9214cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33554
W20260709 12:26:30.313580  5114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 87025.1us
I20260709 12:26:30.322558  5060 tablet_service.cc:1558] Processing DeleteTablet for tablet c872a85641bb42caaf228b2eeeafcc93 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa78544c8fb4f9cbf5ab1a935e18e82 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:39330
I20260709 12:26:30.326179  4967 catalog_manager.cc:5697] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New cstate: current_term: 1 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:30.337981  5221 raft_consensus.cc:2955] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:30.363482  6610 raft_consensus.cc:993] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82: : Instructing follower e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:30.364217  6616 raft_consensus.cc:1081] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Signalling peer e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:30.372365  5056 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f147c4f5ae9479dae2779366c7cf2fe with delete_type TABLET_DATA_TOMBSTONED (TS 0aa78544c8fb4f9cbf5ab1a935e18e82 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39330
I20260709 12:26:30.389745  6664 tablet_replica.cc:333] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:30.390780  6652 raft_consensus.cc:993] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3: : Instructing follower 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:30.397604  6652 raft_consensus.cc:1081] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Signalling peer 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:30.396279  6665 tablet_replica.cc:333] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:30.400745  6665 raft_consensus.cc:2243] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:30.401201  5740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f70fcd244ec422c887a45f476de45f1"
dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:55096
I20260709 12:26:30.414573  5740 raft_consensus.cc:493] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:30.414970  5740 raft_consensus.cc:3060] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.410070  5070 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a00dc8dae764febafe0efdc0fadcdac"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:36034
I20260709 12:26:30.415541  5070 raft_consensus.cc:493] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:30.415786  5070 raft_consensus.cc:3060] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.424506  6664 raft_consensus.cc:2243] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:30.425120  6610 raft_consensus.cc:993] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82: : Instructing follower d22f4ab7b09f42258209170e7c9214cb to start an election
I20260709 12:26:30.425681  6610 raft_consensus.cc:1081] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Signalling peer d22f4ab7b09f42258209170e7c9214cb to start an election
I20260709 12:26:30.427323  5140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdc3c77d7a1a4a4c9cf2c6405234815d"
dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
 from {username='slave'} at 127.0.0.1:33564
I20260709 12:26:30.427930  5140 raft_consensus.cc:493] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:30.428341  5140 raft_consensus.cc:3060] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.435274  6665 raft_consensus.cc:2272] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:30.437158  5740 raft_consensus.cc:515] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:30.436867  5140 raft_consensus.cc:515] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:30.439580  6664 raft_consensus.cc:2272] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:30.439816  5140 leader_election.cc:290] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:30.440191  5070 raft_consensus.cc:515] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:30.440490  5066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc3c77d7a1a4a4c9cf2c6405234815d" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:30.441072  5066 raft_consensus.cc:3055] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:30.441430  5066 raft_consensus.cc:740] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:30.442934  6664 ts_tablet_manager.cc:1916] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:30.442737  5066 consensus_queue.cc:260] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:30.444340  5066 raft_consensus.cc:3060] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.448081  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc3c77d7a1a4a4c9cf2c6405234815d" candidate_uuid: "d22f4ab7b09f42258209170e7c9214cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:30.448796  5218 raft_consensus.cc:3060] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.451320  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00dc8dae764febafe0efdc0fadcdac" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:30.451927  5221 raft_consensus.cc:3055] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:30.452239  5221 raft_consensus.cc:740] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:30.453367  5740 leader_election.cc:290] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:30.453953  5221 consensus_queue.cc:260] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:30.455545  5221 raft_consensus.cc:3060] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.456377  5215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70fcd244ec422c887a45f476de45f1" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:30.457000  5215 raft_consensus.cc:3060] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.463090  5221 raft_consensus.cc:2468] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 2.
I20260709 12:26:30.466495  5039 leader_election.cc:304] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:26:30.467167  6664 ts_tablet_manager.cc:1929] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:30.467573  6616 raft_consensus.cc:2804] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:30.467722  6664 log.cc:1199] T d4c6522d7db94a48b906c63f7c31b8e6 P d22f4ab7b09f42258209170e7c9214cb: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-1-root/wals/d4c6522d7db94a48b906c63f7c31b8e6
I20260709 12:26:30.469653  4956 catalog_manager.cc:5028] TS d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): tablet d4c6522d7db94a48b906c63f7c31b8e6 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:30.469931  5215 raft_consensus.cc:2468] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:30.470068  6616 raft_consensus.cc:697] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:30.471086  5711 leader_election.cc:304] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:30.471025  6616 consensus_queue.cc:237] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:30.471957  6516 raft_consensus.cc:2804] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:30.472456  6516 raft_consensus.cc:697] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
I20260709 12:26:30.473367  6516 consensus_queue.cc:237] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:30.475760  5066 raft_consensus.cc:2468] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 2.
I20260709 12:26:30.472172  5218 raft_consensus.cc:2468] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d22f4ab7b09f42258209170e7c9214cb in term 2.
I20260709 12:26:30.465018  5070 leader_election.cc:290] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 election: Requested vote from peers 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:30.478619  5113 leader_election.cc:304] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:26:30.484890  5067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70fcd244ec422c887a45f476de45f1" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:30.485514  5067 raft_consensus.cc:3055] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:30.485771  5067 raft_consensus.cc:740] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:30.486379  5067 consensus_queue.cc:260] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:30.487354  5067 raft_consensus.cc:3060] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.482549  6637 raft_consensus.cc:2804] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:30.493431  5740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00dc8dae764febafe0efdc0fadcdac" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
I20260709 12:26:30.494170  5740 raft_consensus.cc:3060] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.495087  6637 raft_consensus.cc:697] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Becoming Leader. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:26:30.508438  6637 consensus_queue.cc:237] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:30.518675  5067 raft_consensus.cc:2468] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:30.522032  6665 ts_tablet_manager.cc:1916] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:30.527516  5740 raft_consensus.cc:2468] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 2.
I20260709 12:26:30.550768  4966 catalog_manager.cc:5697] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:30.554587  4967 catalog_manager.cc:5697] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 1 to 2, leader changed from 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 2 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:30.553087  4968 catalog_manager.cc:5697] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to d22f4ab7b09f42258209170e7c9214cb (127.3.200.66). New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:30.597667  6665 ts_tablet_manager.cc:1929] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:26:30.598363  6665 log.cc:1199] T c872a85641bb42caaf228b2eeeafcc93 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root/wals/c872a85641bb42caaf228b2eeeafcc93
I20260709 12:26:30.601686  4957 catalog_manager.cc:5028] TS 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): tablet c872a85641bb42caaf228b2eeeafcc93 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:30.602811  6665 tablet_replica.cc:333] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:30.604087  6665 raft_consensus.cc:2243] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:30.607048  6665 raft_consensus.cc:2272] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:30.612268  6665 ts_tablet_manager.cc:1916] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:30.630739  6665 ts_tablet_manager.cc:1929] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:30.631296  6665 log.cc:1199] T 2f147c4f5ae9479dae2779366c7cf2fe P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root/wals/2f147c4f5ae9479dae2779366c7cf2fe
I20260709 12:26:30.633092  4957 catalog_manager.cc:5028] TS 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): tablet 2f147c4f5ae9479dae2779366c7cf2fe (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:30.867772  5221 raft_consensus.cc:1275] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:30.869299  6545 consensus_queue.cc:1048] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:30.912528  5741 raft_consensus.cc:1275] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:30.917953  6618 consensus_queue.cc:1048] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:26:30.958408  5070 raft_consensus.cc:1275] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:30.961963  6631 consensus_queue.cc:1048] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:30.977885  5218 raft_consensus.cc:1275] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:30.979820  6631 consensus_queue.cc:1048] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:31.039319  5221 raft_consensus.cc:1275] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.045430  6644 consensus_queue.cc:1048] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:31.092629  5070 raft_consensus.cc:1275] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.094362  6644 consensus_queue.cc:1048] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:31.416142  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:31.520097  5070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5afebfa702646d8b7372e8562e97d71"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "6e72ecbdf12a4160856b2a57422118a3"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:31.520761  5070 raft_consensus.cc:606] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 LEADER]: Received request to transfer leadership to TS 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:26:31.524348  5140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c872a85641bb42caaf228b2eeeafcc93"
dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
mode: GRACEFUL
new_leader_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:59770
I20260709 12:26:31.525434  5140 raft_consensus.cc:606] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Received request to transfer leadership to TS e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:31.527858  6545 raft_consensus.cc:993] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82: : Instructing follower 6e72ecbdf12a4160856b2a57422118a3 to start an election
I20260709 12:26:31.528393  6618 raft_consensus.cc:1081] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 LEADER]: Signalling peer 6e72ecbdf12a4160856b2a57422118a3 to start an election
I20260709 12:26:31.530203  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:31.530295  5218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5afebfa702646d8b7372e8562e97d71"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
 from {username='slave'} at 127.0.0.1:37568
I20260709 12:26:31.530988  5218 raft_consensus.cc:493] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:31.531371  5218 raft_consensus.cc:3060] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.532068  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:31.533193  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:31.541134  5218 raft_consensus.cc:515] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:31.554028  5070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5afebfa702646d8b7372e8562e97d71" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:31.554664  5070 raft_consensus.cc:3055] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:31.554960  5070 raft_consensus.cc:740] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:31.555666  5070 consensus_queue.cc:260] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:31.556770  5070 raft_consensus.cc:3060] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.567492  5140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5afebfa702646d8b7372e8562e97d71" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:31.568200  5140 raft_consensus.cc:3060] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.576385  5140 raft_consensus.cc:2468] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 4.
I20260709 12:26:31.576931  5218 leader_election.cc:290] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 4 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:31.580039  5186 leader_election.cc:304] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb; no voters: 
I20260709 12:26:31.580919  6614 raft_consensus.cc:2804] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:31.581424  6614 raft_consensus.cc:697] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 4 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:31.582370  5070 raft_consensus.cc:2468] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 4.
I20260709 12:26:31.582289  6614 consensus_queue.cc:237] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:31.670032  6598 raft_consensus.cc:993] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb: : Instructing follower e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:31.670544  6598 raft_consensus.cc:1081] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Signalling peer e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:31.677201  5740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c872a85641bb42caaf228b2eeeafcc93"
dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:55094
I20260709 12:26:31.677778  5740 raft_consensus.cc:493] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:31.678139  5740 raft_consensus.cc:3060] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.675627  4967 catalog_manager.cc:5697] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 3 to 4, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 4 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:31.682899  5018 auto_rebalancer.cc:629] Failed to schedule move for tablet b5afebfa702646d8b7372e8562e97d71: Illegal state: Replica 0aa78544c8fb4f9cbf5ab1a935e18e82 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } }
I20260709 12:26:31.690327  5218 consensus_queue.cc:237] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:31.704512  5740 raft_consensus.cc:515] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:31.723876  5143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c872a85641bb42caaf228b2eeeafcc93" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:31.724515  5143 raft_consensus.cc:3055] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:31.724830  5143 raft_consensus.cc:740] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d22f4ab7b09f42258209170e7c9214cb, State: Running, Role: LEADER
I20260709 12:26:31.725598  5143 consensus_queue.cc:260] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:31.726667  5143 raft_consensus.cc:3060] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.741688  5143 raft_consensus.cc:2468] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 3.
I20260709 12:26:31.755471  5709 leader_election.cc:304] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d22f4ab7b09f42258209170e7c9214cb, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:31.773260  6653 raft_consensus.cc:2804] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:31.774717  6653 raft_consensus.cc:697] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [term 3 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
I20260709 12:26:31.775785  6653 consensus_queue.cc:237] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:31.779513  5740 leader_election.cc:290] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:31.785547  5140 raft_consensus.cc:1275] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:31.784529  5187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 104317us
I20260709 12:26:31.788887  5067 raft_consensus.cc:1275] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:31.789578  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c872a85641bb42caaf228b2eeeafcc93" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:31.791786  5218 raft_consensus.cc:3060] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.799554  6652 consensus_queue.cc:1048] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:31.813879  5186 consensus_peers.cc:597] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb629cfc440b4e6f8d2ab3ea5e5cba62. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:31.849187  6683 raft_consensus.cc:2955] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:31.874756  5070 raft_consensus.cc:2955] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:31.880191  6682 consensus_queue.cc:1048] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:31.900146  4966 catalog_manager.cc:5697] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 2 to 3, leader changed from d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 3 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:31.915154  5140 consensus_queue.cc:237] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:31.915853  5218 raft_consensus.cc:2468] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 3.
I20260709 12:26:31.933948  5143 raft_consensus.cc:2955] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
W20260709 12:26:31.937878  5112 consensus_peers.cc:597] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7ac38dc58d75468593dee0edaafb81c9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:31.939718  5218 raft_consensus.cc:1275] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:31.940333  5067 raft_consensus.cc:1275] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:31.941532  6598 consensus_queue.cc:1048] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:31.942528  6637 consensus_queue.cc:1048] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:31.967775  4967 catalog_manager.cc:5697] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:32.004068  6687 raft_consensus.cc:2955] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:32.009982  5067 raft_consensus.cc:2955] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:32.016060  5070 raft_consensus.cc:1275] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 4 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:32.019018  6683 consensus_queue.cc:1048] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:32.022018  5221 raft_consensus.cc:2955] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:32.049891  4967 catalog_manager.cc:5697] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:32.066809  5221 consensus_queue.cc:237] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
W20260709 12:26:32.129076  5186 consensus_peers.cc:597] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d650634415db46289a46381b54dde329. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.131948  5144 raft_consensus.cc:1275] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 4 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:32.132829  5143 raft_consensus.cc:1275] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:32.135695  6683 consensus_queue.cc:1048] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:32.136541  5070 raft_consensus.cc:1275] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:32.141381  6685 consensus_queue.cc:1048] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:26:32.148627  6652 consensus_queue.cc:1048] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:32.185636  6705 ts_tablet_manager.cc:933] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:32.199195  6682 raft_consensus.cc:2955] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:32.209321  5067 raft_consensus.cc:2955] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:32.230146  6705 tablet_copy_client.cc:323] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.67:43993
I20260709 12:26:32.232312  5232 tablet_copy_service.cc:140] P 6e72ecbdf12a4160856b2a57422118a3: Received BeginTabletCopySession request for tablet bb629cfc440b4e6f8d2ab3ea5e5cba62 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:34832)
I20260709 12:26:32.233431  5232 tablet_copy_service.cc:161] P 6e72ecbdf12a4160856b2a57422118a3: Beginning new tablet copy session on tablet bb629cfc440b4e6f8d2ab3ea5e5cba62 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:34832: session id = e030bb11bf104d5298a2521f8f7b206b-bb629cfc440b4e6f8d2ab3ea5e5cba62
I20260709 12:26:32.237118  4967 catalog_manager.cc:5697] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 4, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 3 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:32.247896  5232 tablet_copy_source_session.cc:215] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:32.252475  5140 raft_consensus.cc:2955] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:32.258810  6705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb629cfc440b4e6f8d2ab3ea5e5cba62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:32.260313  5218 raft_consensus.cc:1275] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:32.264266  6653 consensus_queue.cc:1048] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:32.327685  6705 tablet_copy_client.cc:806] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:32.328830  6705 tablet_copy_client.cc:670] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:32.339525  6705 tablet_copy_client.cc:538] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:32.350354  5140 raft_consensus.cc:1275] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:32.351569  6705 tablet_bootstrap.cc:492] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:32.352265  6712 consensus_queue.cc:1048] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:32.373335  6713 ts_tablet_manager.cc:933] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:26:32.385524  5186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 61150.2us
I20260709 12:26:32.386891  6713 tablet_copy_client.cc:323] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.66:37067
I20260709 12:26:32.395074  5158 tablet_copy_service.cc:140] P d22f4ab7b09f42258209170e7c9214cb: Received BeginTabletCopySession request for tablet 7ac38dc58d75468593dee0edaafb81c9 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:42108)
I20260709 12:26:32.395624  5158 tablet_copy_service.cc:161] P d22f4ab7b09f42258209170e7c9214cb: Beginning new tablet copy session on tablet 7ac38dc58d75468593dee0edaafb81c9 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:42108: session id = e030bb11bf104d5298a2521f8f7b206b-7ac38dc58d75468593dee0edaafb81c9
I20260709 12:26:32.399281  6705 tablet_bootstrap.cc:492] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:32.402997  6705 tablet_bootstrap.cc:492] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:32.404286  6705 ts_tablet_manager.cc:1403] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.053s	user 0.025s	sys 0.001s
I20260709 12:26:32.409370  6705 raft_consensus.cc:359] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:32.412017  6705 raft_consensus.cc:740] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:32.412896  6705 consensus_queue.cc:260] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:32.410578  5158 tablet_copy_source_session.cc:215] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:32.421137  6705 ts_tablet_manager.cc:1434] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:26:32.421924  6713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac38dc58d75468593dee0edaafb81c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:32.451108  5232 tablet_copy_service.cc:342] P 6e72ecbdf12a4160856b2a57422118a3: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-bb629cfc440b4e6f8d2ab3ea5e5cba62 received from {username='slave'} at 127.0.0.1:34832
I20260709 12:26:32.451596  5232 tablet_copy_service.cc:434] P 6e72ecbdf12a4160856b2a57422118a3: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-bb629cfc440b4e6f8d2ab3ea5e5cba62 on tablet bb629cfc440b4e6f8d2ab3ea5e5cba62 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:32.478637  6713 tablet_copy_client.cc:806] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:32.479211  6713 tablet_copy_client.cc:670] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:32.483086  6713 tablet_copy_client.cc:538] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:32.492830  6713 tablet_bootstrap.cc:492] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:32.524374  6705 ts_tablet_manager.cc:933] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:32.607564  6705 tablet_copy_client.cc:323] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.67:43993
I20260709 12:26:32.609449  5232 tablet_copy_service.cc:140] P 6e72ecbdf12a4160856b2a57422118a3: Received BeginTabletCopySession request for tablet d650634415db46289a46381b54dde329 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:34832)
I20260709 12:26:32.610302  5232 tablet_copy_service.cc:161] P 6e72ecbdf12a4160856b2a57422118a3: Beginning new tablet copy session on tablet d650634415db46289a46381b54dde329 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:34832: session id = e030bb11bf104d5298a2521f8f7b206b-d650634415db46289a46381b54dde329
I20260709 12:26:32.629086  5232 tablet_copy_source_session.cc:215] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:32.634346  6705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d650634415db46289a46381b54dde329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:32.642860  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:32.648190  5741 raft_consensus.cc:1217] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:32.682667  6713 tablet_bootstrap.cc:492] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:32.683800  6713 tablet_bootstrap.cc:492] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:32.686832  6713 ts_tablet_manager.cc:1403] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.194s	user 0.034s	sys 0.005s
I20260709 12:26:32.725284  6713 raft_consensus.cc:359] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:32.730525  6713 raft_consensus.cc:740] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:32.731345  6713 consensus_queue.cc:260] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:32.748203  6713 ts_tablet_manager.cc:1434] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.061s	user 0.002s	sys 0.005s
I20260709 12:26:32.751670  5158 tablet_copy_service.cc:342] P d22f4ab7b09f42258209170e7c9214cb: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-7ac38dc58d75468593dee0edaafb81c9 received from {username='slave'} at 127.0.0.1:42108
I20260709 12:26:32.752125  5158 tablet_copy_service.cc:434] P d22f4ab7b09f42258209170e7c9214cb: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-7ac38dc58d75468593dee0edaafb81c9 on tablet 7ac38dc58d75468593dee0edaafb81c9 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:32.765266  6705 tablet_copy_client.cc:806] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:32.765980  6705 tablet_copy_client.cc:670] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:32.774607  6705 tablet_copy_client.cc:538] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:32.775971  5741 raft_consensus.cc:1217] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:26:32.818143  6705 tablet_bootstrap.cc:492] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:32.849210  5218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4eed62f347644556a405f7e6991cebf7"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
mode: GRACEFUL
new_leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:52694
I20260709 12:26:32.849946  5218 raft_consensus.cc:606] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Received request to transfer leadership to TS 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:26:32.859102  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:26:32.860731  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:32.861454  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:32.907761  6705 tablet_bootstrap.cc:492] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:32.908672  6652 raft_consensus.cc:993] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3: : Instructing follower 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:32.911372  6652 raft_consensus.cc:1081] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Signalling peer 0aa78544c8fb4f9cbf5ab1a935e18e82 to start an election
I20260709 12:26:32.913766  5070 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4eed62f347644556a405f7e6991cebf7"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
 from {username='slave'} at 127.0.0.1:36034
I20260709 12:26:32.914424  5070 raft_consensus.cc:493] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:32.914767  5070 raft_consensus.cc:3060] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.918031  6705 tablet_bootstrap.cc:492] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:32.919169  6705 ts_tablet_manager.cc:1403] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.101s	user 0.023s	sys 0.009s
I20260709 12:26:32.922705  6705 raft_consensus.cc:359] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:32.925658  6705 raft_consensus.cc:740] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:32.924170  5070 raft_consensus.cc:515] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:32.934021  6705 consensus_queue.cc:260] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:32.937290  6705 ts_tablet_manager.cc:1434] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.006s
I20260709 12:26:32.939543  5218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eed62f347644556a405f7e6991cebf7" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:32.940963  5218 raft_consensus.cc:3055] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:32.941310  5218 raft_consensus.cc:740] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:32.942139  5218 consensus_queue.cc:260] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:32.943289  5218 raft_consensus.cc:3060] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.946054  5232 tablet_copy_service.cc:342] P 6e72ecbdf12a4160856b2a57422118a3: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-d650634415db46289a46381b54dde329 received from {username='slave'} at 127.0.0.1:34832
I20260709 12:26:32.946524  5232 tablet_copy_service.cc:434] P 6e72ecbdf12a4160856b2a57422118a3: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-d650634415db46289a46381b54dde329 on tablet d650634415db46289a46381b54dde329 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:32.939863  5070 leader_election.cc:290] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 election: Requested vote from peers 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:32.940357  5741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eed62f347644556a405f7e6991cebf7" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
I20260709 12:26:32.951736  5741 raft_consensus.cc:3060] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.970682  5741 raft_consensus.cc:2468] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 2.
I20260709 12:26:32.980393  5037 leader_election.cc:304] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:32.981271  6545 raft_consensus.cc:2804] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:32.981760  6545 raft_consensus.cc:697] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Becoming Leader. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:32.982591  6545 consensus_queue.cc:237] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:32.998946  5218 raft_consensus.cc:2468] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aa78544c8fb4f9cbf5ab1a935e18e82 in term 2.
I20260709 12:26:33.022684  4966 catalog_manager.cc:5697] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: term changed from 1 to 2, leader changed from 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) to 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65). New cstate: current_term: 2 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.069180  5741 raft_consensus.cc:1217] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:26:33.166143  6652 raft_consensus.cc:1064] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:33.169091  6652 consensus_queue.cc:237] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:33.212148  5741 raft_consensus.cc:1275] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:33.222066  6682 consensus_queue.cc:1048] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:33.242300  6699 raft_consensus.cc:1064] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:33.248518  5070 raft_consensus.cc:1275] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:33.250437  6681 consensus_queue.cc:1048] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:33.252278  6699 consensus_queue.cc:237] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:33.275797  5143 raft_consensus.cc:1275] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:26:33.317099  5187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 57239us
W20260709 12:26:33.350929  5186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 98096.5us
I20260709 12:26:33.387053  5741 raft_consensus.cc:1275] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:33.392421  6687 consensus_queue.cc:1048] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:33.392171  6727 raft_consensus.cc:2955] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:33.404497  5221 raft_consensus.cc:1275] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:33.406410  6637 consensus_queue.cc:1048] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:33.427824  5741 raft_consensus.cc:2955] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:33.438480  6728 consensus_queue.cc:1048] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:26:33.471879  5067 raft_consensus.cc:1275] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:26:33.496445  5039 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 62756.6us
I20260709 12:26:33.497412  5739 raft_consensus.cc:1275] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:33.506577  6616 consensus_queue.cc:1048] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:33.486292  6637 consensus_queue.cc:1048] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:26:33.518002  5070 raft_consensus.cc:2955] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:33.531116  6699 raft_consensus.cc:2955] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
W20260709 12:26:33.545881  5112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:43655, user_credentials={real_user=slave}} blocked reactor thread for 66304.8us
I20260709 12:26:33.549335  5221 raft_consensus.cc:2955] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:33.546355  4968 catalog_manager.cc:5697] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
W20260709 12:26:33.564994  5186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:37067, user_credentials={real_user=slave}} blocked reactor thread for 127751us
I20260709 12:26:33.579792  5215 raft_consensus.cc:1275] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:33.583442  6734 consensus_queue.cc:1048] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:33.594862  5216 consensus_queue.cc:237] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:33.597503  5071 raft_consensus.cc:2955] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:33.602667  5741 raft_consensus.cc:1275] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:33.605322  6681 consensus_queue.cc:1048] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:33.613569  5066 raft_consensus.cc:1275] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:33.620236  6726 consensus_queue.cc:1048] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:33.636246  4966 catalog_manager.cc:5697] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:33.639375  5741 raft_consensus.cc:2955] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:33.658004  5067 raft_consensus.cc:2955] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:33.635591  6728 raft_consensus.cc:2955] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:33.683848  4958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bb629cfc440b4e6f8d2ab3ea5e5cba62 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:33.683853  4966 catalog_manager.cc:5697] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 3 to 4, VOTER d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) evicted. New cstate: current_term: 1 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:33.694594  6726 raft_consensus.cc:1064] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:33.698129  6726 consensus_queue.cc:237] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:33.730398  5136 tablet_service.cc:1558] Processing DeleteTablet for tablet bb629cfc440b4e6f8d2ab3ea5e5cba62 with delete_type TABLET_DATA_TOMBSTONED (TS d22f4ab7b09f42258209170e7c9214cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33554
I20260709 12:26:33.763767  5739 raft_consensus.cc:2955] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:33.782531  5140 raft_consensus.cc:2955] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:33.785784  5143 consensus_queue.cc:237] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:33.843770  5215 raft_consensus.cc:1275] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:33.846258  6637 consensus_queue.cc:1048] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:33.851945  5741 raft_consensus.cc:1275] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:33.856806  6736 raft_consensus.cc:2955] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:33.858855  5070 raft_consensus.cc:1275] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:33.861284  5741 raft_consensus.cc:1275] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b [term 3 LEARNER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:33.860527  5215 raft_consensus.cc:2955] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:33.861411  6735 consensus_queue.cc:1048] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:33.862778  6728 consensus_queue.cc:1048] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:33.874564  5144 raft_consensus.cc:1275] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:33.875466  6637 consensus_queue.cc:1048] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:33.880131  6728 consensus_queue.cc:1048] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:33.884904  6748 tablet_replica.cc:333] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:33.885883  6748 raft_consensus.cc:2243] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:33.886860  6748 raft_consensus.cc:2272] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.892845  4970 catalog_manager.cc:5697] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 4 to 5, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:33.898878  5741 raft_consensus.cc:2955] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:33.909495  6748 ts_tablet_manager.cc:1916] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:33.949033  4956 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7ac38dc58d75468593dee0edaafb81c9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:33.953259  5060 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ac38dc58d75468593dee0edaafb81c9 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa78544c8fb4f9cbf5ab1a935e18e82 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:39330
I20260709 12:26:33.952919  6735 raft_consensus.cc:2955] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:33.957931  5739 raft_consensus.cc:2955] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:33.994235  4970 catalog_manager.cc:5697] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 4 to 5, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:34.003808  6753 tablet_replica.cc:333] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:34.006275  6748 ts_tablet_manager.cc:1929] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:34.006788  6748 log.cc:1199] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P d22f4ab7b09f42258209170e7c9214cb: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-1-root/wals/bb629cfc440b4e6f8d2ab3ea5e5cba62
I20260709 12:26:34.008668  4956 catalog_manager.cc:5028] TS d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): tablet bb629cfc440b4e6f8d2ab3ea5e5cba62 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:34.009074  6753 raft_consensus.cc:2243] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.009882  6753 raft_consensus.cc:2272] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.008880  5070 raft_consensus.cc:2955] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:34.013000  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:34.019249  6753 ts_tablet_manager.cc:1916] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:34.071592  6753 ts_tablet_manager.cc:1929] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:26:34.072149  6753 log.cc:1199] T 7ac38dc58d75468593dee0edaafb81c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root/wals/7ac38dc58d75468593dee0edaafb81c9
I20260709 12:26:34.069705  5215 consensus_queue.cc:237] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:34.074030  4957 catalog_manager.cc:5028] TS 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): tablet 7ac38dc58d75468593dee0edaafb81c9 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:34.077123  5140 raft_consensus.cc:2955] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } attrs { replace: true } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:34.096036  5739 raft_consensus.cc:1275] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:34.104316  5143 raft_consensus.cc:1275] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:34.121213  6652 consensus_queue.cc:1048] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:34.134608  6682 consensus_queue.cc:1048] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:34.181465  5070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f9c81422e73491dba294f24607e5e84"
dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
mode: GRACEFUL
new_leader_uuid: "6e72ecbdf12a4160856b2a57422118a3"
 from {username='slave'} at 127.0.0.1:53636
I20260709 12:26:34.182240  5070 raft_consensus.cc:606] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Received request to transfer leadership to TS 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:26:34.187047  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:26:34.189043  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:34.190027  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:34.240072  6682 raft_consensus.cc:2955] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:34.257371  4958 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d650634415db46289a46381b54dde329 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:34.267371  5740 raft_consensus.cc:2955] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:34.269119  4970 catalog_manager.cc:5697] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 5 to 6, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New cstate: current_term: 3 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:34.269871  5140 raft_consensus.cc:2955] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:34.282204  5060 tablet_service.cc:1558] Processing DeleteTablet for tablet d650634415db46289a46381b54dde329 with delete_type TABLET_DATA_TOMBSTONED (TS 0aa78544c8fb4f9cbf5ab1a935e18e82 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:39330
I20260709 12:26:34.283216  6753 tablet_replica.cc:333] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:34.284302  6753 raft_consensus.cc:2243] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:34.285060  6753 raft_consensus.cc:2272] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:34.295935  6753 ts_tablet_manager.cc:1916] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:34.308082  6545 raft_consensus.cc:993] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82: : Instructing follower 6e72ecbdf12a4160856b2a57422118a3 to start an election
I20260709 12:26:34.308611  6545 raft_consensus.cc:1081] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Signalling peer 6e72ecbdf12a4160856b2a57422118a3 to start an election
I20260709 12:26:34.334779  6753 ts_tablet_manager.cc:1929] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:26:34.334722  5216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f9c81422e73491dba294f24607e5e84"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
 from {username='slave'} at 127.0.0.1:37568
I20260709 12:26:34.335582  5216 raft_consensus.cc:493] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:34.335994  5216 raft_consensus.cc:3060] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.345269  6753 log.cc:1199] T d650634415db46289a46381b54dde329 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-0-root/wals/d650634415db46289a46381b54dde329
I20260709 12:26:34.344403  5216 raft_consensus.cc:515] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:34.348580  5216 leader_election.cc:290] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:34.349407  5066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9c81422e73491dba294f24607e5e84" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:34.350073  5066 raft_consensus.cc:3055] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:34.350441  5066 raft_consensus.cc:740] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aa78544c8fb4f9cbf5ab1a935e18e82, State: Running, Role: LEADER
I20260709 12:26:34.351192  5066 consensus_queue.cc:260] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:34.352782  4957 catalog_manager.cc:5028] TS 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): tablet d650634415db46289a46381b54dde329 (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:34.352351  5066 raft_consensus.cc:3060] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.355165  5140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f9c81422e73491dba294f24607e5e84" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d22f4ab7b09f42258209170e7c9214cb"
I20260709 12:26:34.361716  5066 raft_consensus.cc:2468] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 2.
I20260709 12:26:34.362993  5140 raft_consensus.cc:3060] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.363919  5187 leader_election.cc:304] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3; no voters: 
I20260709 12:26:34.365034  6727 raft_consensus.cc:2804] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:34.365535  6727 raft_consensus.cc:697] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:34.366457  6727 consensus_queue.cc:237] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:34.373152  5140 raft_consensus.cc:2468] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 2.
I20260709 12:26:34.402146  4970 catalog_manager.cc:5697] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 2 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:34.898329  5066 raft_consensus.cc:1275] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:34.899699  6652 consensus_queue.cc:1048] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:34.933889  5140 raft_consensus.cc:1275] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:34.942109  6682 consensus_queue.cc:1048] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:35.333637  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:35.624452  5216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47ebaac790104c1b849ecbeadadc2ac6"
dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
mode: GRACEFUL
new_leader_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:52694
I20260709 12:26:35.638967  5216 raft_consensus.cc:606] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Received request to transfer leadership to TS e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:35.659206  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:26:35.662642  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:35.664261  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:35.722538  5140 consensus_queue.cc:237] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:35.743763  5216 raft_consensus.cc:1275] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:26:35.744251  5112 consensus_peers.cc:597] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cdc3c77d7a1a4a4c9cf2c6405234815d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:35.745607  5071 raft_consensus.cc:1275] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:35.747087  6736 consensus_queue.cc:1048] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:35.748237  6764 consensus_queue.cc:1048] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:35.772383  6764 raft_consensus.cc:2955] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:35.774598  5066 raft_consensus.cc:2955] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:35.781549  6682 raft_consensus.cc:993] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3: : Instructing follower e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:35.782186  6682 raft_consensus.cc:1081] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Signalling peer e030bb11bf104d5298a2521f8f7b206b to start an election
I20260709 12:26:35.784425  5741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47ebaac790104c1b849ecbeadadc2ac6"
dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
 from {username='slave'} at 127.0.0.1:35796
I20260709 12:26:35.785117  5741 raft_consensus.cc:493] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:35.785490  5741 raft_consensus.cc:3060] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:35.793867  5741 raft_consensus.cc:515] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:35.797101  4967 catalog_manager.cc:5697] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 reported cstate change: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:35.797912  5221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ebaac790104c1b849ecbeadadc2ac6" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:35.798636  5221 raft_consensus.cc:3055] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:35.798995  5221 raft_consensus.cc:740] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:35.801551  5071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ebaac790104c1b849ecbeadadc2ac6" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82"
I20260709 12:26:35.802309  5071 raft_consensus.cc:3060] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:35.802007  5215 consensus_queue.cc:237] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:35.799999  5221 consensus_queue.cc:260] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:35.804474  5221 raft_consensus.cc:3060] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:35.810075  5071 raft_consensus.cc:2468] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:35.814116  5710 leader_election.cc:304] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:35.815171  5221 raft_consensus.cc:2468] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:35.817637  6738 raft_consensus.cc:2804] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:35.818301  6738 raft_consensus.cc:697] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
I20260709 12:26:35.819360  6738 consensus_queue.cc:237] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:35.813208  5741 leader_election.cc:290] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:35.830423  5071 raft_consensus.cc:1275] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 4 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:35.832099  5140 raft_consensus.cc:1275] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 4 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:35.834317  6765 consensus_queue.cc:1048] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:35.839318  6727 consensus_queue.cc:1048] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:26:35.851346  5186 consensus_peers.cc:597] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5afebfa702646d8b7372e8562e97d71. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:35.853094  5221 raft_consensus.cc:2955] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:35.868754  6727 raft_consensus.cc:2955] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:35.877745  4966 catalog_manager.cc:5697] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 1 to 2, leader changed from 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:35.872143  5139 raft_consensus.cc:2955] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:35.903482  5071 raft_consensus.cc:2955] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:35.942378  5071 consensus_queue.cc:237] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:35.958977  4970 catalog_manager.cc:5697] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index -1 to 5, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 4 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:35.983743  5216 raft_consensus.cc:1275] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:35.991425  6747 consensus_queue.cc:1048] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:35.993808  5139 raft_consensus.cc:1275] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:26:35.999848  5037 consensus_peers.cc:597] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 02feac6bfeab4925b7a3a954250788e4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:36.000522  6747 consensus_queue.cc:1048] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:36.020246  6734 raft_consensus.cc:2955] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:36.021266  5139 raft_consensus.cc:2955] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:36.044806  4970 catalog_manager.cc:5697] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 2 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:36.049392  5216 raft_consensus.cc:2955] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:36.096102  5071 consensus_queue.cc:237] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:36.107937  5216 raft_consensus.cc:1275] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:36.109833  6782 consensus_queue.cc:1048] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:36.117597  5139 raft_consensus.cc:1275] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:36.120404  5037 consensus_peers.cc:597] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 -> Peer e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655): Couldn't send request to peer e030bb11bf104d5298a2521f8f7b206b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ada8dc88d254884a47e7eb4f7f18244. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:36.129765  6734 consensus_queue.cc:1048] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:36.160292  5221 raft_consensus.cc:2955] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:36.161491  6762 raft_consensus.cc:2955] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:36.187409  4970 catalog_manager.cc:5697] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:36.190496  5140 raft_consensus.cc:2955] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } } }
I20260709 12:26:36.256315  6787 ts_tablet_manager.cc:933] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:36.269833  5215 raft_consensus.cc:1275] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:36.306679  6788 ts_tablet_manager.cc:933] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:36.307065  6775 consensus_queue.cc:1048] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:26:36.334244  6787 tablet_copy_client.cc:323] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.66:37067
I20260709 12:26:36.344619  5158 tablet_copy_service.cc:140] P d22f4ab7b09f42258209170e7c9214cb: Received BeginTabletCopySession request for tablet cdc3c77d7a1a4a4c9cf2c6405234815d from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:42108)
I20260709 12:26:36.345252  5158 tablet_copy_service.cc:161] P d22f4ab7b09f42258209170e7c9214cb: Beginning new tablet copy session on tablet cdc3c77d7a1a4a4c9cf2c6405234815d from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:42108: session id = e030bb11bf104d5298a2521f8f7b206b-cdc3c77d7a1a4a4c9cf2c6405234815d
I20260709 12:26:36.349424  6788 tablet_copy_client.cc:323] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.67:43993
I20260709 12:26:36.351548  5232 tablet_copy_service.cc:140] P 6e72ecbdf12a4160856b2a57422118a3: Received BeginTabletCopySession request for tablet b5afebfa702646d8b7372e8562e97d71 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:34832)
I20260709 12:26:36.351729  5071 raft_consensus.cc:1275] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:36.352025  5232 tablet_copy_service.cc:161] P 6e72ecbdf12a4160856b2a57422118a3: Beginning new tablet copy session on tablet b5afebfa702646d8b7372e8562e97d71 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:34832: session id = e030bb11bf104d5298a2521f8f7b206b-b5afebfa702646d8b7372e8562e97d71
I20260709 12:26:36.353668  6775 consensus_queue.cc:1048] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:36.360188  5232 tablet_copy_source_session.cc:215] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:36.368944  6788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5afebfa702646d8b7372e8562e97d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:36.361719  5158 tablet_copy_source_session.cc:215] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:36.384896  6787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdc3c77d7a1a4a4c9cf2c6405234815d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:36.386660  6788 tablet_copy_client.cc:806] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:36.387382  6788 tablet_copy_client.cc:670] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:36.412076  6788 tablet_copy_client.cc:538] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:36.422016  6787 tablet_copy_client.cc:806] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:36.422647  6787 tablet_copy_client.cc:670] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:36.429951  6788 tablet_bootstrap.cc:492] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:36.431963  6787 tablet_copy_client.cc:538] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:36.448967  6797 ts_tablet_manager.cc:933] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149)
I20260709 12:26:36.466111  6797 tablet_copy_client.cc:323] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.65:37149
I20260709 12:26:36.468200  5083 tablet_copy_service.cc:140] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Received BeginTabletCopySession request for tablet 02feac6bfeab4925b7a3a954250788e4 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:53396)
I20260709 12:26:36.468791  5083 tablet_copy_service.cc:161] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Beginning new tablet copy session on tablet 02feac6bfeab4925b7a3a954250788e4 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:53396: session id = e030bb11bf104d5298a2521f8f7b206b-02feac6bfeab4925b7a3a954250788e4
I20260709 12:26:36.478504  5083 tablet_copy_source_session.cc:215] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:36.505228  6787 tablet_bootstrap.cc:492] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:36.510917  6797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02feac6bfeab4925b7a3a954250788e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:36.547406  6800 ts_tablet_manager.cc:933] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b: Initiating tablet copy from peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149)
I20260709 12:26:36.549194  6797 tablet_copy_client.cc:806] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:36.549860  6797 tablet_copy_client.cc:670] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:36.559528  6797 tablet_copy_client.cc:538] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:36.575744  6797 tablet_bootstrap.cc:492] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:36.590394  6788 tablet_bootstrap.cc:492] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:36.591848  6788 tablet_bootstrap.cc:492] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:36.592581  6788 ts_tablet_manager.cc:1403] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.163s	user 0.014s	sys 0.022s
I20260709 12:26:36.595913  6788 raft_consensus.cc:359] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:36.596890  6788 raft_consensus.cc:740] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:36.598022  6788 consensus_queue.cc:260] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:36.601248  6788 ts_tablet_manager.cc:1434] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:26:36.603303  5232 tablet_copy_service.cc:342] P 6e72ecbdf12a4160856b2a57422118a3: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-b5afebfa702646d8b7372e8562e97d71 received from {username='slave'} at 127.0.0.1:34832
I20260709 12:26:36.603631  5232 tablet_copy_service.cc:434] P 6e72ecbdf12a4160856b2a57422118a3: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-b5afebfa702646d8b7372e8562e97d71 on tablet b5afebfa702646d8b7372e8562e97d71 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:36.605945  6800 tablet_copy_client.cc:323] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Beginning tablet copy session from remote peer at address 127.3.200.65:37149
I20260709 12:26:36.607759  5083 tablet_copy_service.cc:140] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Received BeginTabletCopySession request for tablet 6ada8dc88d254884a47e7eb4f7f18244 from peer e030bb11bf104d5298a2521f8f7b206b ({username='slave'} at 127.0.0.1:53396)
I20260709 12:26:36.608270  5083 tablet_copy_service.cc:161] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Beginning new tablet copy session on tablet 6ada8dc88d254884a47e7eb4f7f18244 from peer e030bb11bf104d5298a2521f8f7b206b at {username='slave'} at 127.0.0.1:53396: session id = e030bb11bf104d5298a2521f8f7b206b-6ada8dc88d254884a47e7eb4f7f18244
I20260709 12:26:36.610351  5739 raft_consensus.cc:1217] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 12:26:36.619930  6787 tablet_bootstrap.cc:492] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:36.621418  5083 tablet_copy_source_session.cc:215] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:36.625592  6787 tablet_bootstrap.cc:492] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:36.628335  6800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ada8dc88d254884a47e7eb4f7f18244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:36.631513  6787 ts_tablet_manager.cc:1403] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.127s	user 0.027s	sys 0.001s
I20260709 12:26:36.640805  6787 raft_consensus.cc:359] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:36.641618  6787 raft_consensus.cc:740] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:36.642305  6787 consensus_queue.cc:260] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:36.653471  6787 ts_tablet_manager.cc:1434] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 12:26:36.660863  5158 tablet_copy_service.cc:342] P d22f4ab7b09f42258209170e7c9214cb: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-cdc3c77d7a1a4a4c9cf2c6405234815d received from {username='slave'} at 127.0.0.1:42108
I20260709 12:26:36.661304  5158 tablet_copy_service.cc:434] P d22f4ab7b09f42258209170e7c9214cb: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-cdc3c77d7a1a4a4c9cf2c6405234815d on tablet cdc3c77d7a1a4a4c9cf2c6405234815d with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:36.653389  5739 raft_consensus.cc:1217] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:26:36.698906  6800 tablet_copy_client.cc:806] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:36.699741  6800 tablet_copy_client.cc:670] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:36.705405  6800 tablet_copy_client.cc:538] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:36.716121  6800 tablet_bootstrap.cc:492] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap starting.
I20260709 12:26:36.737668  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:36.731179  6797 tablet_bootstrap.cc:492] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:36.745458  6797 tablet_bootstrap.cc:492] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:36.753155  6797 ts_tablet_manager.cc:1403] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.178s	user 0.027s	sys 0.006s
I20260709 12:26:36.756381  6797 raft_consensus.cc:359] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:36.760727  6797 raft_consensus.cc:740] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:36.761519  6797 consensus_queue.cc:260] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:36.763675  6797 ts_tablet_manager.cc:1434] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:26:36.774104  5083 tablet_copy_service.cc:342] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-02feac6bfeab4925b7a3a954250788e4 received from {username='slave'} at 127.0.0.1:53396
I20260709 12:26:36.774639  5083 tablet_copy_service.cc:434] P 0aa78544c8fb4f9cbf5ab1a935e18e82: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-02feac6bfeab4925b7a3a954250788e4 on tablet 02feac6bfeab4925b7a3a954250788e4 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:36.783268  6800 tablet_bootstrap.cc:492] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:36.784250  6800 tablet_bootstrap.cc:492] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b: Bootstrap complete.
I20260709 12:26:36.792889  6800 ts_tablet_manager.cc:1403] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b: Time spent bootstrapping tablet: real 0.077s	user 0.023s	sys 0.003s
I20260709 12:26:36.796957  6800 raft_consensus.cc:359] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:36.818120  6800 raft_consensus.cc:740] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Initialized, Role: LEARNER
I20260709 12:26:36.818898  6800 consensus_queue.cc:260] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: NON_VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: true } }
I20260709 12:26:36.821885  6800 ts_tablet_manager.cc:1434] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:26:36.824393  5083 tablet_copy_service.cc:342] P 0aa78544c8fb4f9cbf5ab1a935e18e82: Request end of tablet copy session e030bb11bf104d5298a2521f8f7b206b-6ada8dc88d254884a47e7eb4f7f18244 received from {username='slave'} at 127.0.0.1:53396
I20260709 12:26:36.824843  5083 tablet_copy_service.cc:434] P 0aa78544c8fb4f9cbf5ab1a935e18e82: ending tablet copy session e030bb11bf104d5298a2521f8f7b206b-6ada8dc88d254884a47e7eb4f7f18244 on tablet 6ada8dc88d254884a47e7eb4f7f18244 with peer e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:36.895104  5739 raft_consensus.cc:1217] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:26:36.974040  3873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:36.975692  3873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:36.976440  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:37.018352  5739 raft_consensus.cc:1217] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:37.071661  6736 raft_consensus.cc:1064] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:37.074162  6736 consensus_queue.cc:237] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:37.140875  3873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:37.145362  5739 raft_consensus.cc:1275] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:37.148028  5071 raft_consensus.cc:1275] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:37.149425  5221 raft_consensus.cc:1275] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:37.153190  6637 consensus_queue.cc:1048] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:37.155045  6637 consensus_queue.cc:1048] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:37.166724  6736 consensus_queue.cc:1048] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:26:37.190171  5186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:43655, user_credentials={real_user=slave}} blocked reactor thread for 78132.2us
I20260709 12:26:37.204602  5739 raft_consensus.cc:2955] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:37.209088  6637 raft_consensus.cc:2955] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:37.267794  5066 raft_consensus.cc:2955] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:37.282867  4968 catalog_manager.cc:5697] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b reported cstate change: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:37.295662  5221 raft_consensus.cc:2955] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:37.311851  3873 tablet_server.cc:179] TabletServer@127.3.200.65:0 shutting down...
I20260709 12:26:37.323724  6747 raft_consensus.cc:1064] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
W20260709 12:26:37.333032  5187 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
I20260709 12:26:37.326427  6747 consensus_queue.cc:237] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:37.339069  6807 raft_consensus.cc:1064] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:37.341814  6807 consensus_queue.cc:237] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:37.377254  5739 raft_consensus.cc:1275] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEARNER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:37.377358  5143 raft_consensus.cc:1275] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:37.379829  6782 consensus_queue.cc:1048] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:37.413944  5221 raft_consensus.cc:1275] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:37.415328  6762 consensus_queue.cc:1048] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
W20260709 12:26:37.435724  5187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 102823us
W20260709 12:26:37.449049  5710 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 103298us
W20260709 12:26:37.493140  6818 log.cc:927] Time spent T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 12:26:37.541884  5113 consensus_peers.cc:597] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.542927  5113 consensus_peers.cc:597] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.543569  5113 consensus_peers.cc:597] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.545300  6762 consensus_queue.cc:1048] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:26:37.558087  5113 consensus_peers.cc:597] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.568727  5741 raft_consensus.cc:1275] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b [term 4 LEARNER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:37.570516  5140 raft_consensus.cc:1275] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 4 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:26:37.595157  5113 consensus_peers.cc:597] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.597314  5113 consensus_peers.cc:597] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.608592  6826 consensus_queue.cc:1048] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:37.634418  6762 raft_consensus.cc:1064] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82: attempting to promote NON_VOTER e030bb11bf104d5298a2521f8f7b206b to VOTER
I20260709 12:26:37.639704  6762 consensus_queue.cc:237] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:37.644874  5187 consensus_peers.cc:597] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.646296  5187 consensus_peers.cc:597] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.650022  6822 consensus_queue.cc:1175] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e030bb11bf104d5298a2521f8f7b206b" responder_term: 2 status { last_received { term: 2 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 2 index: 4 } }
W20260709 12:26:37.650892  5039 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:43993, user_credentials={real_user=slave}} blocked reactor thread for 45827.3us
W20260709 12:26:37.657236  5113 consensus_peers.cc:597] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.657996  5186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:43655, user_credentials={real_user=slave}} blocked reactor thread for 46048.9us
I20260709 12:26:37.668174  6765 consensus_queue.cc:1048] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:26:37.673184  5187 consensus_peers.cc:597] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.674883  5187 consensus_peers.cc:597] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.681380  5113 consensus_peers.cc:597] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.684605  5187 consensus_peers.cc:597] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.685374  5187 consensus_peers.cc:597] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.684712  5143 consensus_queue.cc:237] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:37.692664  5737 raft_consensus.cc:1275] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Refusing update from remote peer d22f4ab7b09f42258209170e7c9214cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:37.694766  5737 raft_consensus.cc:1275] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b [term 1 LEARNER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:37.695539  6822 consensus_queue.cc:1048] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:37.695940  5140 raft_consensus.cc:1275] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:26:37.698539  5113 consensus_peers.cc:597] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.705371  6782 consensus_queue.cc:1048] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:26:37.705425  6822 raft_consensus.cc:2955] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:37.708173  5737 raft_consensus.cc:2955] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
W20260709 12:26:37.704913  5187 consensus_peers.cc:597] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.724241  5221 raft_consensus.cc:1275] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Refusing update from remote peer 0aa78544c8fb4f9cbf5ab1a935e18e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:37.720718  6762 consensus_queue.cc:1048] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:26:37.727299  6830 raft_consensus.cc:2955] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
W20260709 12:26:37.740893  5187 consensus_peers.cc:597] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.746014  5741 raft_consensus.cc:2955] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
W20260709 12:26:37.740291  5710 consensus_peers.cc:597] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.749145  6747 consensus_queue.cc:1048] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:37.751718  3873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:37.771077  3873 tablet_replica.cc:333] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:37.772432  3873 raft_consensus.cc:2243] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:26:37.776948  5113 consensus_peers.cc:597] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.777906  3873 raft_consensus.cc:2272] T c89d4eb4d7d548c88dc21b8bafee287e P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.781919  5144 raft_consensus.cc:2955] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:37.784324  3873 tablet_replica.cc:333] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:37.784665  5218 raft_consensus.cc:2955] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:37.790230  3873 raft_consensus.cc:2243] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:26:37.778788  5187 consensus_peers.cc:597] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.806942  5710 consensus_peers.cc:597] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.811473  5710 consensus_peers.cc:597] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.818668  3873 raft_consensus.cc:2272] T 3a00dc8dae764febafe0efdc0fadcdac P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:37.826112  5187 consensus_peers.cc:597] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.828766  3873 tablet_replica.cc:333] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:37.829315  4967 catalog_manager.cc:5697] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 3 to 4, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:37.831758  4956 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cdc3c77d7a1a4a4c9cf2c6405234815d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:37.837478  3873 raft_consensus.cc:2243] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:37.815439  5710 consensus_peers.cc:597] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.841348  5710 consensus_peers.cc:597] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.855583  3873 raft_consensus.cc:2272] T 3f70fcd244ec422c887a45f476de45f1 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:37.860879  5710 consensus_peers.cc:597] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.861981  5710 consensus_peers.cc:597] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.862545  5710 consensus_peers.cc:597] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.880434  5710 consensus_peers.cc:597] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.883600  4967 catalog_manager.cc:5697] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb reported cstate change: config changed from index 4 to 5, VOTER 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67) evicted. New cstate: current_term: 2 leader_uuid: "d22f4ab7b09f42258209170e7c9214cb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:37.885406  6830 raft_consensus.cc:2955] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:37.888275  5220 raft_consensus.cc:2955] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:37.896184  5143 raft_consensus.cc:2955] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:37.904748  5204 tablet_service.cc:1558] Processing DeleteTablet for tablet cdc3c77d7a1a4a4c9cf2c6405234815d with delete_type TABLET_DATA_TOMBSTONED (TS 6e72ecbdf12a4160856b2a57422118a3 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:37564
I20260709 12:26:37.903703  6838 raft_consensus.cc:2955] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:37.911265  5740 raft_consensus.cc:2955] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:37.918419  3873 tablet_replica.cc:333] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:37.919472  3873 raft_consensus.cc:2243] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.930305  6844 tablet_replica.cc:333] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:37.937589  4966 catalog_manager.cc:5697] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
W20260709 12:26:37.958911  5710 consensus_peers.cc:597] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.963642  5143 raft_consensus.cc:2955] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:37.968693  6844 raft_consensus.cc:2243] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.969455  6844 raft_consensus.cc:2272] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.920439  3873 raft_consensus.cc:2272] T 07469c82367d44f58e1a33659fefd477 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.978665  6844 ts_tablet_manager.cc:1916] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:37.963472  5740 raft_consensus.cc:2955] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } } }
I20260709 12:26:37.980499  4966 catalog_manager.cc:5697] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: config changed from index 5 to 6, e030bb11bf104d5298a2521f8f7b206b (127.3.200.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:37.986899  3873 tablet_replica.cc:333] T 1f1a988a2c4745a2baccff62720af502 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:37.990468  3873 raft_consensus.cc:2243] T 1f1a988a2c4745a2baccff62720af502 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.991137  3873 raft_consensus.cc:2272] T 1f1a988a2c4745a2baccff62720af502 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.994311  3873 tablet_replica.cc:333] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:37.995178  3873 raft_consensus.cc:2243] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.996308  3873 raft_consensus.cc:2272] T 0bd4cf6677164933b892bc384682a045 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.015292  6844 ts_tablet_manager.cc:1929] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:26:38.015827  3873 tablet_replica.cc:333] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.015923  6844 log.cc:1199] T cdc3c77d7a1a4a4c9cf2c6405234815d P 6e72ecbdf12a4160856b2a57422118a3: Deleting WAL directory at /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599884178482-3873-0/minicluster-data/ts-2-root/wals/cdc3c77d7a1a4a4c9cf2c6405234815d
I20260709 12:26:38.022344  3873 raft_consensus.cc:2243] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.023047  3873 raft_consensus.cc:2272] T 4f9c81422e73491dba294f24607e5e84 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.032392  4958 catalog_manager.cc:5028] TS 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): tablet cdc3c77d7a1a4a4c9cf2c6405234815d (table test-workload [id=bc9b417720e34db6b58b94c1899dd692]) successfully deleted
I20260709 12:26:38.038147  3873 tablet_replica.cc:333] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.039141  3873 raft_consensus.cc:2243] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.039784  3873 raft_consensus.cc:2272] T 23c924d344cb49639d42d3f21aa08cf2 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.043081  3873 tablet_replica.cc:333] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.044045  3873 raft_consensus.cc:2243] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.045173  3873 raft_consensus.cc:2272] T 97e28bbe53df40bda7a921f79ae0514f P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.048143  3873 tablet_replica.cc:333] T b34eeef728364ce7a688984bb7fbbb91 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.049119  3873 raft_consensus.cc:2243] T b34eeef728364ce7a688984bb7fbbb91 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.049778  3873 raft_consensus.cc:2272] T b34eeef728364ce7a688984bb7fbbb91 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.052983  3873 tablet_replica.cc:333] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.056948  3873 raft_consensus.cc:2243] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.060487  3873 raft_consensus.cc:2272] T f863b6a5fcc24d979cc005aaef6827ae P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.063730  3873 tablet_replica.cc:333] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.064707  3873 raft_consensus.cc:2243] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.065711  3873 raft_consensus.cc:2272] T cdc3c77d7a1a4a4c9cf2c6405234815d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.074165  3873 tablet_replica.cc:333] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.075197  3873 raft_consensus.cc:2243] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.076309  3873 raft_consensus.cc:2272] T e5b732ffbeea492c9c4d91376c781263 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.079996  3873 tablet_replica.cc:333] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.080930  3873 raft_consensus.cc:2243] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.082012  3873 raft_consensus.cc:2272] T 7292f06cb5514a80849fe386d1f5edd5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.127152  3873 tablet_replica.cc:333] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.128153  3873 raft_consensus.cc:2243] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.128875  3873 raft_consensus.cc:2272] T b10627fec43d464e94516d46e5afc694 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.148818  3873 tablet_replica.cc:333] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.149821  3873 raft_consensus.cc:2243] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.150969  3873 raft_consensus.cc:2272] T 500a5a8d445949f0b0d635fd3820f5c9 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.156250  3873 tablet_replica.cc:333] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.157251  3873 raft_consensus.cc:2243] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.157928  3873 raft_consensus.cc:2272] T 04afa18a0a324c0d9788a17d1182585b P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.161264  3873 tablet_replica.cc:333] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.162295  3873 raft_consensus.cc:2243] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.162998  3873 raft_consensus.cc:2272] T b5afebfa702646d8b7372e8562e97d71 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.165922  3873 tablet_replica.cc:333] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.166816  3873 raft_consensus.cc:2243] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.167949  3873 raft_consensus.cc:2272] T 45d46b792a2145b79909220733d7a533 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.170846  3873 tablet_replica.cc:333] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.180291  3873 raft_consensus.cc:2243] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.181317  3873 raft_consensus.cc:2272] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.184343  3873 tablet_replica.cc:333] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.185247  3873 raft_consensus.cc:2243] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.186043  3873 raft_consensus.cc:2272] T f424fe8428004213860887c1e4ed5796 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.207481  3873 tablet_replica.cc:333] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.208397  3873 raft_consensus.cc:2243] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.209022  3873 raft_consensus.cc:2272] T f6812f3677044ecba0f8e57690bef590 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.211660  3873 tablet_replica.cc:333] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.212467  3873 raft_consensus.cc:2243] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.213058  3873 raft_consensus.cc:2272] T ec76d9e7afeb4c04b652649a01ebdc52 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.232072  3873 tablet_replica.cc:333] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.233052  3873 raft_consensus.cc:2243] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.234416  3873 raft_consensus.cc:2272] T 22a881bcc72945ed82bb9c3b8125ada4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.240235  3873 tablet_replica.cc:333] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.241070  3873 raft_consensus.cc:2243] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.241871  3873 raft_consensus.cc:2272] T ccce9c827ef54c7fa65928fda3eb7acf P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.245222  3873 tablet_replica.cc:333] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.246055  3873 raft_consensus.cc:2243] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.246933  3873 raft_consensus.cc:2272] T d1640ee2f62349858037e353ecde48d8 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.250356  3873 tablet_replica.cc:333] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.310707  3873 raft_consensus.cc:2243] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.312212  3873 raft_consensus.cc:2272] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.316589  3873 tablet_replica.cc:333] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.316674  6830 raft_consensus.cc:493] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e030bb11bf104d5298a2521f8f7b206b)
I20260709 12:26:38.317525  3873 raft_consensus.cc:2243] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.317258  6830 raft_consensus.cc:515] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:38.318953  3873 raft_consensus.cc:2272] T 02feac6bfeab4925b7a3a954250788e4 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.319567  6830 leader_election.cc:290] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:38.324635  5139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d91e17c8c3b4cac9a128316050ce7df" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:26:38.328752  5737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d91e17c8c3b4cac9a128316050ce7df" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
I20260709 12:26:38.333335  5037 leader_election.cc:304] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: d22f4ab7b09f42258209170e7c9214cb, e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:38.339165  6762 raft_consensus.cc:2749] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.340955  6762 raft_consensus.cc:493] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e030bb11bf104d5298a2521f8f7b206b)
I20260709 12:26:38.341542  6762 raft_consensus.cc:515] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:38.343835  6762 leader_election.cc:290] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:38.346813  5139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034ac3e487504f54ac6e50430a0b22d7" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:26:38.347602  5737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034ac3e487504f54ac6e50430a0b22d7" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
I20260709 12:26:38.357676  6762 raft_consensus.cc:493] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:38.358345  6762 raft_consensus.cc:515] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:38.360651  6762 leader_election.cc:290] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:38.362298  5139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73298cac061840a88d6e43468fbb541d" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d22f4ab7b09f42258209170e7c9214cb" is_pre_election: true
I20260709 12:26:38.362980  5737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73298cac061840a88d6e43468fbb541d" candidate_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
I20260709 12:26:38.327855  3873 tablet_replica.cc:333] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.366262  3873 raft_consensus.cc:2243] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.367194  3873 raft_consensus.cc:2272] T f8da98a042af4ca9ac0ae86911498913 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.370994  5037 leader_election.cc:304] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: d22f4ab7b09f42258209170e7c9214cb, e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:38.372908  6762 raft_consensus.cc:2749] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.374071  5037 leader_election.cc:304] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aa78544c8fb4f9cbf5ab1a935e18e82; no voters: d22f4ab7b09f42258209170e7c9214cb, e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:38.375212  6762 raft_consensus.cc:2749] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:38.381294  3873 tablet_replica.cc:333] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.382269  3873 raft_consensus.cc:2243] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.382881  3873 raft_consensus.cc:2272] T 253cc4e85c5b4c18ac746b32b0a47e47 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.385653  3873 tablet_replica.cc:333] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.386427  3873 raft_consensus.cc:2243] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.387022  3873 raft_consensus.cc:2272] T 034ac3e487504f54ac6e50430a0b22d7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.389673  3873 tablet_replica.cc:333] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.390434  3873 raft_consensus.cc:2243] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.391503  3873 raft_consensus.cc:2272] T d4c6522d7db94a48b906c63f7c31b8e6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.398497  3873 tablet_replica.cc:333] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.399338  3873 raft_consensus.cc:2243] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.399940  3873 raft_consensus.cc:2272] T 52040c8bb853412eae96ea2727c6f8f5 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.402886  3873 tablet_replica.cc:333] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.403618  3873 raft_consensus.cc:2243] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.404490  3873 raft_consensus.cc:2272] T 22b25036e425414d9ac336d8b3074769 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.407958  3873 tablet_replica.cc:333] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.411226  3873 raft_consensus.cc:2243] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.412943  3873 raft_consensus.cc:2272] T 47ebaac790104c1b849ecbeadadc2ac6 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.415530  3873 tablet_replica.cc:333] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.418294  3873 raft_consensus.cc:2243] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.419203  3873 raft_consensus.cc:2272] T 73298cac061840a88d6e43468fbb541d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.429536  3873 tablet_replica.cc:333] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.430382  3873 raft_consensus.cc:2243] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.430969  3873 raft_consensus.cc:2272] T 56941204ae3e40bba5254fad3092ebeb P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.434217  3873 tablet_replica.cc:333] T c83bfe7fc28a4548aa8923c761e8108d P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.435009  3873 raft_consensus.cc:2243] T c83bfe7fc28a4548aa8923c761e8108d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.435516  3873 raft_consensus.cc:2272] T c83bfe7fc28a4548aa8923c761e8108d P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.438232  3873 tablet_replica.cc:333] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.440071  3873 raft_consensus.cc:2243] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.440872  3873 raft_consensus.cc:2272] T 5d91e17c8c3b4cac9a128316050ce7df P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.443802  3873 tablet_replica.cc:333] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.444447  3873 raft_consensus.cc:2243] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.445137  3873 raft_consensus.cc:2272] T 8c3c3b60ecf04db989b454ae1f760212 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.447991  3873 tablet_replica.cc:333] T ee33af6c31104d4abfff69a578ddc361 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.456023  3873 raft_consensus.cc:2243] T ee33af6c31104d4abfff69a578ddc361 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.456650  3873 raft_consensus.cc:2272] T ee33af6c31104d4abfff69a578ddc361 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.459405  3873 tablet_replica.cc:333] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.460153  3873 raft_consensus.cc:2243] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.460915  3873 raft_consensus.cc:2272] T d1704f04d7be4e899c5cf5d05207f303 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.463761  3873 tablet_replica.cc:333] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.464434  3873 raft_consensus.cc:2243] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.465024  3873 raft_consensus.cc:2272] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.474233  3873 tablet_replica.cc:333] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.476220  3873 raft_consensus.cc:2243] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.477365  3873 raft_consensus.cc:2272] T 4eed62f347644556a405f7e6991cebf7 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.480741  3873 tablet_replica.cc:333] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82: stopping tablet replica
I20260709 12:26:38.481400  3873 raft_consensus.cc:2243] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.482571  3873 raft_consensus.cc:2272] T 6ada8dc88d254884a47e7eb4f7f18244 P 0aa78544c8fb4f9cbf5ab1a935e18e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.744002  3873 tablet_server.cc:196] TabletServer@127.3.200.65:0 shutdown complete.
I20260709 12:26:38.876612  3873 tablet_server.cc:179] TabletServer@127.3.200.66:0 shutting down...
I20260709 12:26:38.917575  6652 raft_consensus.cc:493] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:38.918167  6652 raft_consensus.cc:515] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:38.920305  6652 leader_election.cc:290] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:26:38.935693  5187 leader_election.cc:336] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
W20260709 12:26:38.937228  5709 consensus_peers.cc:597] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:38.964779  5709 consensus_peers.cc:597] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:38.977665  5709 consensus_peers.cc:597] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:38.981575  5709 consensus_peers.cc:597] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:39.004312  5186 leader_election.cc:336] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:39.004925  5186 leader_election.cc:304] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:39.008134  6652 raft_consensus.cc:2749] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:39.009083  5186 consensus_peers.cc:597] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:39.010962  5186 consensus_peers.cc:597] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:39.044234  5186 consensus_peers.cc:597] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:39.044912  3873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:26:39.045717  5709 consensus_peers.cc:597] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:39.048048  3873 tablet_replica.cc:333] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.049564  3873 raft_consensus.cc:2243] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.050210  3873 raft_consensus.cc:2272] T 2ebf5bf87e474e0fbdecf20901b28622 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:39.052645  5709 consensus_peers.cc:597] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:39.053287  3873 tablet_replica.cc:333] T c89d4eb4d7d548c88dc21b8bafee287e P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.054471  3873 raft_consensus.cc:2243] T c89d4eb4d7d548c88dc21b8bafee287e P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.055187  3873 raft_consensus.cc:2272] T c89d4eb4d7d548c88dc21b8bafee287e P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.062724  3873 tablet_replica.cc:333] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.063805  3873 raft_consensus.cc:2243] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.064455  3873 raft_consensus.cc:2272] T 1838a7c5a8e448ff84f311a659312dff P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.067699  3873 tablet_replica.cc:333] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.068724  3873 raft_consensus.cc:2243] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:39.069916  3873 raft_consensus.cc:2272] T 8f0b7d7401864a6cadec140ae4603df6 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.072958  3873 tablet_replica.cc:333] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.073870  3873 raft_consensus.cc:2243] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.074749  3873 raft_consensus.cc:2272] T a3a3a987e8c145f484b2c0aa9890ed20 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.077824  3873 tablet_replica.cc:333] T 07469c82367d44f58e1a33659fefd477 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.078467  6652 raft_consensus.cc:493] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.078990  6652 raft_consensus.cc:515] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.080461  3873 raft_consensus.cc:2243] T 07469c82367d44f58e1a33659fefd477 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.081184  3873 raft_consensus.cc:2272] T 07469c82367d44f58e1a33659fefd477 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.084000  3873 tablet_replica.cc:333] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.084973  3873 raft_consensus.cc:2243] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.085578  3873 raft_consensus.cc:2272] T 0bd4cf6677164933b892bc384682a045 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.088544  3873 tablet_replica.cc:333] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.089476  3873 raft_consensus.cc:2243] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.090098  3873 raft_consensus.cc:2272] T 4799f16941ac411c958d31adc8dbd44a P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.092444  5740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00dc8dae764febafe0efdc0fadcdac" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
I20260709 12:26:39.093042  3873 tablet_replica.cc:333] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.094074  3873 raft_consensus.cc:2243] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.094204  6652 leader_election.cc:290] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:39.094723  3873 raft_consensus.cc:2272] T 4f9c81422e73491dba294f24607e5e84 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:39.094887  5187 leader_election.cc:336] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.096925  5187 leader_election.cc:304] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:39.098006  3873 tablet_replica.cc:333] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.098953  3873 raft_consensus.cc:2243] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.099810  3873 raft_consensus.cc:2272] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.100436  6812 raft_consensus.cc:2749] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.102660  3873 tablet_replica.cc:333] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.103627  3873 raft_consensus.cc:2243] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.104185  3873 raft_consensus.cc:2272] T 23c924d344cb49639d42d3f21aa08cf2 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.107096  6812 raft_consensus.cc:493] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.107631  6812 raft_consensus.cc:515] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:39.110277  3873 tablet_replica.cc:333] T e5b732ffbeea492c9c4d91376c781263 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.111593  3873 raft_consensus.cc:2243] T e5b732ffbeea492c9c4d91376c781263 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.112149  6826 raft_consensus.cc:493] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.112247  3873 raft_consensus.cc:2272] T e5b732ffbeea492c9c4d91376c781263 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.112809  6826 raft_consensus.cc:515] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:39.115644  3873 tablet_replica.cc:333] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.116644  3873 raft_consensus.cc:2243] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:26:39.117545  5186 leader_election.cc:336] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:39.117743  3873 raft_consensus.cc:2272] T b34eeef728364ce7a688984bb7fbbb91 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.120589  3873 tablet_replica.cc:333] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.121492  3873 raft_consensus.cc:2243] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:39.122597  3873 raft_consensus.cc:2272] T 2f147c4f5ae9479dae2779366c7cf2fe P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.123101  6826 leader_election.cc:290] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:39.126411  3873 tablet_replica.cc:333] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.127329  3873 raft_consensus.cc:2243] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:39.127710  6812 leader_election.cc:290] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:26:39.128407  5186 leader_election.cc:336] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:39.128371  3873 raft_consensus.cc:2272] T cdc3c77d7a1a4a4c9cf2c6405234815d P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.132673  3873 tablet_replica.cc:333] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.132840  6805 raft_consensus.cc:493] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.133584  3873 raft_consensus.cc:2243] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.133373  6805 raft_consensus.cc:515] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.134523  3873 raft_consensus.cc:2272] T 7292f06cb5514a80849fe386d1f5edd5 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.137287  3873 tablet_replica.cc:333] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.138144  3873 raft_consensus.cc:2243] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:39.139204  3873 raft_consensus.cc:2272] T 7ac38dc58d75468593dee0edaafb81c9 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:39.140806  5710 leader_election.cc:336] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.142132  3873 tablet_replica.cc:333] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.143111  3873 raft_consensus.cc:2243] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:39.145170  3873 raft_consensus.cc:2272] T f424fe8428004213860887c1e4ed5796 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.145387  6805 leader_election.cc:290] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:39.148070  3873 tablet_replica.cc:333] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.149014  3873 raft_consensus.cc:2243] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:39.150048  3873 raft_consensus.cc:2272] T 9ea368926e6346baa3b0065d3c9c510e P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.152853  3873 tablet_replica.cc:333] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
W20260709 12:26:39.153505  5186 consensus_peers.cc:597] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:39.153702  3873 raft_consensus.cc:2243] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.154644  3873 raft_consensus.cc:2272] T ffee9280ebbb43bf892976cab5021757 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.157511  3873 tablet_replica.cc:333] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
W20260709 12:26:39.157934  5186 consensus_peers.cc:597] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:39.158358  3873 raft_consensus.cc:2243] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.159030  3873 raft_consensus.cc:2272] T c83bfe7fc28a4548aa8923c761e8108d P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:39.160789  5709 consensus_peers.cc:597] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:39.161785  3873 tablet_replica.cc:333] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.162710  3873 raft_consensus.cc:2243] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.163362  3873 raft_consensus.cc:2272] T 5d91e17c8c3b4cac9a128316050ce7df P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.164914  5216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00dc8dae764febafe0efdc0fadcdac" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:26:39.165570  5216 raft_consensus.cc:2468] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:39.166165  3873 tablet_replica.cc:333] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.167052  3873 raft_consensus.cc:2243] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:39.168098  3873 raft_consensus.cc:2272] T 04f60339b6c34e54bbf6e9b4a4c1e54e P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.171085  3873 tablet_replica.cc:333] T f6812f3677044ecba0f8e57690bef590 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.171972  3873 raft_consensus.cc:2243] T f6812f3677044ecba0f8e57690bef590 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.172540  3873 raft_consensus.cc:2272] T f6812f3677044ecba0f8e57690bef590 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.175374  3873 tablet_replica.cc:333] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.176234  3873 raft_consensus.cc:2243] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.176882  3873 raft_consensus.cc:2272] T 45d46b792a2145b79909220733d7a533 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.179684  3873 tablet_replica.cc:333] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.180537  3873 raft_consensus.cc:2243] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.181337  3873 raft_consensus.cc:2272] T b5afebfa702646d8b7372e8562e97d71 P d22f4ab7b09f42258209170e7c9214cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.184144  3873 tablet_replica.cc:333] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.184725  5711 leader_election.cc:304] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:26:39.185082  3873 raft_consensus.cc:2243] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.185863  6805 raft_consensus.cc:2804] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:39.186062  3873 raft_consensus.cc:2272] T 56941204ae3e40bba5254fad3092ebeb P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.186254  6805 raft_consensus.cc:493] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.186698  6805 raft_consensus.cc:3060] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.189014  3873 tablet_replica.cc:333] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.189929  3873 raft_consensus.cc:2243] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.190469  3873 raft_consensus.cc:2272] T 52040c8bb853412eae96ea2727c6f8f5 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.193286  3873 tablet_replica.cc:333] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.194108  3873 raft_consensus.cc:2243] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:39.195133  3873 raft_consensus.cc:2272] T 22b25036e425414d9ac336d8b3074769 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.197981  3873 tablet_replica.cc:333] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.198758  3873 raft_consensus.cc:2243] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:39.199718  3873 raft_consensus.cc:2272] T 253cc4e85c5b4c18ac746b32b0a47e47 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.202386  3873 tablet_replica.cc:333] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.203299  3873 raft_consensus.cc:2243] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.204012  3873 raft_consensus.cc:2272] T 02feac6bfeab4925b7a3a954250788e4 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.206710  3873 tablet_replica.cc:333] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.207509  3873 raft_consensus.cc:2243] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.208233  3873 raft_consensus.cc:2272] T 6ada8dc88d254884a47e7eb4f7f18244 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:39.210402  5186 consensus_peers.cc:597] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:39.210960  3873 tablet_replica.cc:333] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
W20260709 12:26:39.210850  5187 leader_election.cc:336] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.211391  5187 leader_election.cc:304] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:39.211880  3873 raft_consensus.cc:2243] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.212071  6652 raft_consensus.cc:2749] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.212715  3873 raft_consensus.cc:2272] T d650634415db46289a46381b54dde329 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:39.213378  5187 leader_election.cc:336] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.213824  5187 leader_election.cc:304] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:39.215481  3873 tablet_replica.cc:333] T 1f1a988a2c4745a2baccff62720af502 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.215332  6805 raft_consensus.cc:515] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.216423  3873 raft_consensus.cc:2243] T 1f1a988a2c4745a2baccff62720af502 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.217141  3873 raft_consensus.cc:2272] T 1f1a988a2c4745a2baccff62720af502 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.220088  3873 tablet_replica.cc:333] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.220865  3873 raft_consensus.cc:2243] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.221369  3873 raft_consensus.cc:2272] T 034ac3e487504f54ac6e50430a0b22d7 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.223984  3873 tablet_replica.cc:333] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.224695  3873 raft_consensus.cc:2243] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:39.225642  3873 raft_consensus.cc:2272] T ee33af6c31104d4abfff69a578ddc361 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:39.226794  5710 leader_election.cc:336] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.228068  3873 tablet_replica.cc:333] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.228888  3873 raft_consensus.cc:2243] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.229583  3873 raft_consensus.cc:2272] T f3892e26d8f94adabf8bd2581fee782b P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:39.231792  5709 consensus_peers.cc:597] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:39.240691  3873 tablet_replica.cc:333] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.241634  3873 raft_consensus.cc:2243] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.242219  3873 raft_consensus.cc:2272] T 4c62b8870a024d5692b8e8b85185dbd6 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.244805  3873 tablet_replica.cc:333] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.245535  3873 raft_consensus.cc:2243] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:39.246583  3873 raft_consensus.cc:2272] T 04afa18a0a324c0d9788a17d1182585b P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.249119  3873 tablet_replica.cc:333] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.250000  3873 raft_consensus.cc:2243] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:39.250926  3873 raft_consensus.cc:2272] T 73298cac061840a88d6e43468fbb541d P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:39.252847  5709 consensus_peers.cc:597] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:39.253657  3873 tablet_replica.cc:333] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.254518  3873 raft_consensus.cc:2243] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:39.255595  3873 raft_consensus.cc:2272] T ccce9c827ef54c7fa65928fda3eb7acf P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.258422  3873 tablet_replica.cc:333] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.259239  3873 raft_consensus.cc:2243] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.259805  3873 raft_consensus.cc:2272] T d1640ee2f62349858037e353ecde48d8 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.262743  3873 tablet_replica.cc:333] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.262835  6652 raft_consensus.cc:2749] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.263500  3873 raft_consensus.cc:2243] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:39.264513  3873 raft_consensus.cc:2272] T ec76d9e7afeb4c04b652649a01ebdc52 P d22f4ab7b09f42258209170e7c9214cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.264940  6652 raft_consensus.cc:493] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.265429  6652 raft_consensus.cc:515] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:39.267282  3873 tablet_replica.cc:333] T 22a881bcc72945ed82bb9c3b8125ada4 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.267443  6652 leader_election.cc:290] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:39.268090  3873 raft_consensus.cc:2243] T 22a881bcc72945ed82bb9c3b8125ada4 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.268723  3873 raft_consensus.cc:2272] T 22a881bcc72945ed82bb9c3b8125ada4 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.271217  3873 tablet_replica.cc:333] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
W20260709 12:26:39.271330  5186 leader_election.cc:336] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:39.271966  3873 raft_consensus.cc:2243] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:39.272188  5187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 58832.9us
I20260709 12:26:39.272632  3873 raft_consensus.cc:2272] T c872a85641bb42caaf228b2eeeafcc93 P d22f4ab7b09f42258209170e7c9214cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.275467  3873 tablet_replica.cc:333] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb: stopping tablet replica
I20260709 12:26:39.275713  6805 leader_election.cc:290] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:39.276196  3873 raft_consensus.cc:2243] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:39.276925  3873 raft_consensus.cc:2272] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P d22f4ab7b09f42258209170e7c9214cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.278008  6652 raft_consensus.cc:493] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.278479  6652 raft_consensus.cc:515] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
W20260709 12:26:39.284248  5186 leader_election.cc:336] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:39.284765  6652 leader_election.cc:290] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:26:39.289783  5186 consensus_peers.cc:597] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:39.292208  5216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a00dc8dae764febafe0efdc0fadcdac" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:39.292771  5216 raft_consensus.cc:3060] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:39.303841  5186 consensus_peers.cc:597] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:39.306756  5216 raft_consensus.cc:2468] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 3.
I20260709 12:26:39.314028  5711 leader_election.cc:304] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:26:39.315202  6805 raft_consensus.cc:2804] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:39.316380  6805 raft_consensus.cc:697] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 3 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
I20260709 12:26:39.317288  6805 consensus_queue.cc:237] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:39.325986  5187 leader_election.cc:336] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.326426  5187 leader_election.cc:304] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
W20260709 12:26:39.340785  5709 consensus_peers.cc:597] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:39.366195  5709 consensus_peers.cc:597] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:39.370213  6652 raft_consensus.cc:2749] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:39.371203  5187 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:37149, user_credentials={real_user=slave}} blocked reactor thread for 45241.7us
W20260709 12:26:39.369706  5186 consensus_peers.cc:597] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:39.372206  5186 consensus_peers.cc:597] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:39.381655  6652 raft_consensus.cc:493] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.382177  6652 raft_consensus.cc:515] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.384060  6652 leader_election.cc:290] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:39.386471  5740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863b6a5fcc24d979cc005aaef6827ae" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
W20260709 12:26:39.391386  5186 consensus_peers.cc:597] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:39.399621  5187 leader_election.cc:336] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.410351  5187 leader_election.cc:304] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:39.414209  6652 raft_consensus.cc:2749] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.413511  4966 catalog_manager.cc:5697] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 2 to 3, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 3 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.426895  6855 raft_consensus.cc:493] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.427765  6855 raft_consensus.cc:515] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:39.432868  5187 leader_election.cc:336] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.433357  5187 leader_election.cc:304] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:39.436527  6826 raft_consensus.cc:2749] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.438861  5216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500a5a8d445949f0b0d635fd3820f5c9" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:26:39.435272  6855 leader_election.cc:290] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
W20260709 12:26:39.444962  5710 leader_election.cc:336] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.445622  5710 leader_election.cc:304] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:26:39.446722  6854 raft_consensus.cc:2749] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.449517  6826 raft_consensus.cc:493] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.450941  6826 raft_consensus.cc:515] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.453239  6826 leader_election.cc:290] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:39.455578  6854 raft_consensus.cc:493] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.457063  6854 raft_consensus.cc:515] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:39.460281  5187 leader_election.cc:336] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.460929  6854 leader_election.cc:290] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:26:39.474627  5710 leader_election.cc:336] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
W20260709 12:26:39.480922  5709 leader_election.cc:336] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:39.481456  5709 leader_election.cc:304] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:39.482216  6854 raft_consensus.cc:2749] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.488903  5737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500a5a8d445949f0b0d635fd3820f5c9" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
I20260709 12:26:39.489567  5737 raft_consensus.cc:2468] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:26:39.507709  5186 leader_election.cc:304] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:26:39.508702  6851 raft_consensus.cc:2804] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:39.509073  6851 raft_consensus.cc:493] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.509413  6851 raft_consensus.cc:3060] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.518939  6851 raft_consensus.cc:515] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.521673  6652 raft_consensus.cc:493] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.531742  6652 raft_consensus.cc:515] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:39.533806  6652 leader_election.cc:290] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:39.525396  6854 raft_consensus.cc:493] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.535351  6854 raft_consensus.cc:515] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.538913  5216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863b6a5fcc24d979cc005aaef6827ae" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:26:39.539515  5216 raft_consensus.cc:2468] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:39.541827  5711 leader_election.cc:304] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:39.542127  6854 leader_election.cc:290] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:39.542773  6854 raft_consensus.cc:2804] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:39.545585  6854 raft_consensus.cc:493] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.546069  6854 raft_consensus.cc:3060] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:39.549439  5710 leader_election.cc:336] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
W20260709 12:26:39.545122  5186 leader_election.cc:336] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
W20260709 12:26:39.550678  5187 leader_election.cc:336] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.552911  5187 leader_election.cc:304] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:39.553608  6652 raft_consensus.cc:2749] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.555145  6851 leader_election.cc:290] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:39.557492  5737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500a5a8d445949f0b0d635fd3820f5c9" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
I20260709 12:26:39.558214  5737 raft_consensus.cc:3060] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:39.560158  5187 leader_election.cc:336] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.565408  5737 raft_consensus.cc:2468] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 2.
I20260709 12:26:39.567117  5186 leader_election.cc:304] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:26:39.568032  6652 raft_consensus.cc:2804] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:39.568491  6652 raft_consensus.cc:697] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:39.569317  6652 consensus_queue.cc:237] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.575904  6854 raft_consensus.cc:515] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.581233  5216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863b6a5fcc24d979cc005aaef6827ae" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:39.581830  5216 raft_consensus.cc:3060] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.590158  6854 leader_election.cc:290] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:39.590862  5216 raft_consensus.cc:2468] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 3.
I20260709 12:26:39.591235  4966 catalog_manager.cc:5697] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 2 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:39.593950  5710 leader_election.cc:336] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.597849  5711 leader_election.cc:304] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:26:39.598873  6854 raft_consensus.cc:2804] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:39.599342  6854 raft_consensus.cc:697] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 3 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
I20260709 12:26:39.601043  6854 consensus_queue.cc:237] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.602682  6836 raft_consensus.cc:493] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.603204  6836 raft_consensus.cc:515] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.605578  6836 leader_election.cc:290] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:39.612311  5216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eed62f347644556a405f7e6991cebf7" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:26:39.613080  6652 raft_consensus.cc:493] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.613736  6652 raft_consensus.cc:515] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.618573  6652 leader_election.cc:290] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
W20260709 12:26:39.625823  5710 leader_election.cc:336] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.627571  5710 leader_election.cc:304] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:26:39.629583  6855 raft_consensus.cc:2749] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.630491  5737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c6522d7db94a48b906c63f7c31b8e6" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
W20260709 12:26:39.635080  5187 leader_election.cc:336] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.635480  5187 leader_election.cc:304] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:39.636139  6851 raft_consensus.cc:2749] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.637451  4970 catalog_manager.cc:5697] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 2 to 3, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 3 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.641528  6851 raft_consensus.cc:493] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.642132  6851 raft_consensus.cc:515] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.650723  6851 leader_election.cc:290] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:39.651687  5737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02feac6bfeab4925b7a3a954250788e4" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
W20260709 12:26:39.654250  5186 leader_election.cc:336] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:39.655815  5186 leader_election.cc:304] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb, e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:39.657495  6851 raft_consensus.cc:2749] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:39.660336  5187 leader_election.cc:336] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
W20260709 12:26:39.661288  5187 consensus_peers.cc:597] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:39.674650  6854 raft_consensus.cc:493] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.675205  6854 raft_consensus.cc:515] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.677743  6854 leader_election.cc:290] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:39.679533  5216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c6522d7db94a48b906c63f7c31b8e6" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:26:39.680277  5216 raft_consensus.cc:2468] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 1.
I20260709 12:26:39.681275  5711 leader_election.cc:304] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:39.682055  6854 raft_consensus.cc:2804] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:39.682431  6854 raft_consensus.cc:493] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.682803  6854 raft_consensus.cc:3060] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:39.685740  5710 leader_election.cc:336] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.690335  6854 raft_consensus.cc:515] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.692972  6854 leader_election.cc:290] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:39.694795  5216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4c6522d7db94a48b906c63f7c31b8e6" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:39.695401  5216 raft_consensus.cc:3060] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:39.698239  5710 leader_election.cc:336] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.702402  5216 raft_consensus.cc:2468] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:39.703967  5711 leader_election.cc:304] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:26:39.705010  6854 raft_consensus.cc:2804] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:39.705502  6854 raft_consensus.cc:697] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
I20260709 12:26:39.706411  6854 consensus_queue.cc:237] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:39.707197  5710 consensus_peers.cc:597] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:39.731933  4970 catalog_manager.cc:5697] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 1 to 2, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.738353  6854 raft_consensus.cc:493] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.739014  6854 raft_consensus.cc:515] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:39.757635  5709 leader_election.cc:336] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:39.759917  5216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02feac6bfeab4925b7a3a954250788e4" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:26:39.760615  5216 raft_consensus.cc:2468] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:39.761927  6854 leader_election.cc:290] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
W20260709 12:26:39.765033  5710 leader_election.cc:336] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.765511  5710 leader_election.cc:304] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
W20260709 12:26:39.769789  5710 consensus_peers.cc:597] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:39.768980  6854 raft_consensus.cc:2749] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:39.783794  5710 consensus_peers.cc:597] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:39.815801  6836 raft_consensus.cc:493] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.816423  6836 raft_consensus.cc:515] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.818823  6836 leader_election.cc:290] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:39.829950  5216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8da98a042af4ca9ac0ae86911498913" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
W20260709 12:26:39.831127  5710 leader_election.cc:336] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.838279  5216 raft_consensus.cc:1275] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:39.843025  5711 leader_election.cc:304] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, 6e72ecbdf12a4160856b2a57422118a3
I20260709 12:26:39.843815  6805 raft_consensus.cc:2749] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.845606  6805 consensus_queue.cc:1048] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:39.863750  6652 raft_consensus.cc:493] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.864331  6652 raft_consensus.cc:515] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.866993  6652 leader_election.cc:290] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
W20260709 12:26:39.868844  5187 consensus_peers.cc:597] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:39.872448  6855 raft_consensus.cc:493] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
W20260709 12:26:39.873092  5187 leader_election.cc:336] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.872690  6652 raft_consensus.cc:493] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.874338  6652 raft_consensus.cc:515] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.873113  6855 raft_consensus.cc:515] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.876400  6652 leader_election.cc:290] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
W20260709 12:26:39.881842  5710 leader_election.cc:336] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
W20260709 12:26:39.883009  5187 leader_election.cc:336] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.893859  6855 leader_election.cc:290] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
W20260709 12:26:39.894521  5709 leader_election.cc:336] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:39.901306  5709 leader_election.cc:304] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:39.902536  6865 raft_consensus.cc:2749] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.905037  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada8dc88d254884a47e7eb4f7f18244" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:26:39.905714  5220 raft_consensus.cc:2468] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 1.
I20260709 12:26:39.912313  5737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada8dc88d254884a47e7eb4f7f18244" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
I20260709 12:26:39.913033  5737 raft_consensus.cc:2468] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:26:39.925225  6652 raft_consensus.cc:493] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.926082  5737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8da98a042af4ca9ac0ae86911498913" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
I20260709 12:26:39.928411  5737 raft_consensus.cc:2468] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 2.
I20260709 12:26:39.928061  6652 raft_consensus.cc:515] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:39.933132  5186 leader_election.cc:336] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:39.934765  5186 leader_election.cc:304] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:39.936017  6812 raft_consensus.cc:2749] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.931985  6652 leader_election.cc:290] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
W20260709 12:26:39.941815  5187 leader_election.cc:336] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:39.946813  5186 leader_election.cc:304] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:26:39.947679  6652 raft_consensus.cc:2804] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:39.948091  6652 raft_consensus.cc:493] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.948472  6652 raft_consensus.cc:3060] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.959857  6652 raft_consensus.cc:515] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:39.962143  5737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eed62f347644556a405f7e6991cebf7" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
I20260709 12:26:39.965433  5737 raft_consensus.cc:2468] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 2.
I20260709 12:26:39.966784  5186 leader_election.cc:304] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82
I20260709 12:26:39.969101  6826 raft_consensus.cc:2804] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:39.969481  6826 raft_consensus.cc:493] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:39.969854  6826 raft_consensus.cc:3060] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.988054  5737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8da98a042af4ca9ac0ae86911498913" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
I20260709 12:26:39.988760  5737 raft_consensus.cc:3060] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.995851  5737 raft_consensus.cc:2468] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 3.
I20260709 12:26:39.968447  6652 leader_election.cc:290] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
W20260709 12:26:39.997213  5710 consensus_peers.cc:597] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:39.998857  5186 leader_election.cc:304] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:39.999711  6852 raft_consensus.cc:2804] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:40.000181  6852 raft_consensus.cc:697] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:40.001044  6852 consensus_queue.cc:237] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:40.001744  5187 consensus_peers.cc:597] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:39.997259  6826 raft_consensus.cc:515] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:40.008884  6826 leader_election.cc:290] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 election: Requested vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:40.012321  5737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eed62f347644556a405f7e6991cebf7" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
I20260709 12:26:40.012984  5737 raft_consensus.cc:3060] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:40.015606  5187 leader_election.cc:336] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:40.025930  4966 catalog_manager.cc:5697] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 2 to 3, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 3 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:40.035382  5710 consensus_peers.cc:597] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:40.051152  5737 raft_consensus.cc:2468] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 3.
W20260709 12:26:40.052495  5187 consensus_peers.cc:597] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:40.053923  5186 leader_election.cc:304] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 
W20260709 12:26:40.054719  5187 leader_election.cc:336] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:40.055080  6826 raft_consensus.cc:2804] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:40.055864  6826 raft_consensus.cc:697] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:40.056910  6826 consensus_queue.cc:237] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:40.074712  5187 consensus_peers.cc:597] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:40.082182  4970 catalog_manager.cc:5697] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 2 to 3, leader changed from 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65) to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 3 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:40.089995  5220 raft_consensus.cc:1275] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:40.091956  6805 consensus_queue.cc:1048] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:26:40.120993  5187 consensus_peers.cc:597] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:40.122148  6852 raft_consensus.cc:493] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.122713  6852 raft_consensus.cc:515] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:40.124881  6852 leader_election.cc:290] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:26:40.130820  5710 consensus_peers.cc:597] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:40.134989  5186 leader_election.cc:336] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
W20260709 12:26:40.138542  5187 leader_election.cc:336] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:40.139079  5187 leader_election.cc:304] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.139925  6852 raft_consensus.cc:2749] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.145398  6805 raft_consensus.cc:493] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.145967  6805 raft_consensus.cc:515] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:40.147694  6805 leader_election.cc:290] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:40.149003  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f0b7d7401864a6cadec140ae4603df6" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
W20260709 12:26:40.152211  5709 leader_election.cc:336] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.152709  5709 leader_election.cc:304] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e030bb11bf104d5298a2521f8f7b206b; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.153412  6836 raft_consensus.cc:2749] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:40.158218  5710 consensus_peers.cc:597] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:40.170513  5187 consensus_peers.cc:597] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:40.181216  6836 raft_consensus.cc:493] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.181878  6836 raft_consensus.cc:515] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:40.184639  6836 leader_election.cc:290] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:40.185851  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f60339b6c34e54bbf6e9b4a4c1e54e" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
W20260709 12:26:40.190485  5709 leader_election.cc:336] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.190968  5709 leader_election.cc:304] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e030bb11bf104d5298a2521f8f7b206b; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.191944  5737 raft_consensus.cc:1275] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:40.193403  6836 raft_consensus.cc:2749] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.193852  6826 raft_consensus.cc:493] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.194411  6826 raft_consensus.cc:515] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:40.195008  6652 consensus_queue.cc:1048] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:40.196913  6826 leader_election.cc:290] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:40.198449  5740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea368926e6346baa3b0065d3c9c510e" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
W20260709 12:26:40.205299  5186 leader_election.cc:336] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.205941  5186 leader_election.cc:304] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb, e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:40.207690  6852 raft_consensus.cc:2749] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:40.221398  5187 consensus_peers.cc:597] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:40.227562  5187 consensus_peers.cc:597] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:40.247725  5187 consensus_peers.cc:597] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:40.253083  6836 raft_consensus.cc:493] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.253652  6836 raft_consensus.cc:515] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:40.254606  5710 consensus_peers.cc:597] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:40.255390  5710 consensus_peers.cc:597] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:40.255719  6836 leader_election.cc:290] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:40.257341  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f147c4f5ae9479dae2779366c7cf2fe" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:26:40.259027  6812 raft_consensus.cc:493] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.259526  6812 raft_consensus.cc:515] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:40.261642  6812 leader_election.cc:290] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:40.263432  5740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f60339b6c34e54bbf6e9b4a4c1e54e" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
I20260709 12:26:40.264066  5740 raft_consensus.cc:2468] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
W20260709 12:26:40.267128  5186 leader_election.cc:336] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
W20260709 12:26:40.269845  5709 leader_election.cc:336] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.270318  5709 leader_election.cc:304] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e030bb11bf104d5298a2521f8f7b206b; no voters: 6e72ecbdf12a4160856b2a57422118a3, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.272042  6805 raft_consensus.cc:2749] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.272955  5186 leader_election.cc:304] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.273711  6812 raft_consensus.cc:2804] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:40.274081  6812 raft_consensus.cc:493] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.274439  6812 raft_consensus.cc:3060] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.275094  5220 raft_consensus.cc:1275] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:40.277243  6836 consensus_queue.cc:1048] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:26:40.286237  5710 consensus_peers.cc:597] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:40.289795  6812 raft_consensus.cc:515] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:40.291977  6812 leader_election.cc:290] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:40.292912  5740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f60339b6c34e54bbf6e9b4a4c1e54e" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
I20260709 12:26:40.293519  5740 raft_consensus.cc:3060] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:40.299297  5186 leader_election.cc:336] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.302772  5740 raft_consensus.cc:2468] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 2.
I20260709 12:26:40.310102  6854 raft_consensus.cc:493] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.310698  6854 raft_consensus.cc:515] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:40.311553  5710 consensus_peers.cc:597] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:40.312882  6854 leader_election.cc:290] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:26:40.317627  5710 leader_election.cc:336] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:40.319819  5186 leader_election.cc:304] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.321091  6851 raft_consensus.cc:2804] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.321689  6851 raft_consensus.cc:697] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:40.322837  6851 consensus_queue.cc:237] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:40.327278  5709 leader_election.cc:336] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.327760  5709 leader_election.cc:304] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.328418  6836 raft_consensus.cc:2749] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:40.333557  5187 consensus_peers.cc:597] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:40.346526  4966 catalog_manager.cc:5697] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 1 to 2, leader changed from d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 2 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:40.352600  6851 raft_consensus.cc:493] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.353252  6851 raft_consensus.cc:515] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:40.368181  5710 consensus_peers.cc:597] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:40.372494  5186 leader_election.cc:336] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.375954  6812 raft_consensus.cc:493] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.376545  6812 raft_consensus.cc:515] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:40.377209  6851 leader_election.cc:290] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:40.377319  5740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f147c4f5ae9479dae2779366c7cf2fe" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
I20260709 12:26:40.378051  5740 raft_consensus.cc:2468] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:26:40.378943  6812 leader_election.cc:290] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:40.380198  5186 leader_election.cc:304] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.382071  6812 raft_consensus.cc:2804] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:40.382516  6812 raft_consensus.cc:493] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.383014  6812 raft_consensus.cc:3060] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:40.384267  5187 leader_election.cc:336] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
W20260709 12:26:40.387626  5186 leader_election.cc:336] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.388149  5186 leader_election.cc:304] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.388899  6652 raft_consensus.cc:493] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.389382  6652 raft_consensus.cc:515] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:40.390892  6812 raft_consensus.cc:515] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:40.391273  6652 leader_election.cc:290] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:40.391757  6851 raft_consensus.cc:2749] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.393342  6812 leader_election.cc:290] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:40.394550  5740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac38dc58d75468593dee0edaafb81c9" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
I20260709 12:26:40.395707  5737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f147c4f5ae9479dae2779366c7cf2fe" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
I20260709 12:26:40.396350  5737 raft_consensus.cc:3060] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:40.399260  5186 leader_election.cc:336] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.399745  5186 leader_election.cc:304] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: d22f4ab7b09f42258209170e7c9214cb, e030bb11bf104d5298a2521f8f7b206b
I20260709 12:26:40.400441  6851 raft_consensus.cc:2749] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:40.401467  5186 leader_election.cc:336] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.407528  6851 raft_consensus.cc:493] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.408349  6851 raft_consensus.cc:515] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:40.409624  5737 raft_consensus.cc:2468] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 2.
I20260709 12:26:40.411602  6851 leader_election.cc:290] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:40.412498  5186 leader_election.cc:304] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.413326  6812 raft_consensus.cc:2804] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.413904  6812 raft_consensus.cc:697] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:40.414816  6812 consensus_queue.cc:237] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:40.422257  5187 leader_election.cc:336] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
W20260709 12:26:40.423885  5186 leader_election.cc:336] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.424427  5186 leader_election.cc:304] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.425868  6851 raft_consensus.cc:2749] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:40.436617  3873 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 5169)
I20260709 12:26:40.439242  4966 catalog_manager.cc:5697] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 1 to 2, leader changed from d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 2 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:40.452579  5187 consensus_peers.cc:597] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:40.478807  6836 raft_consensus.cc:493] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.479310  6836 raft_consensus.cc:515] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:40.483214  6854 raft_consensus.cc:493] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.483731  6854 raft_consensus.cc:515] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:40.484942  6855 raft_consensus.cc:493] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.485459  6855 raft_consensus.cc:515] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:40.487270  5709 leader_election.cc:336] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.487721  6855 leader_election.cc:290] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:40.489899  6836 leader_election.cc:290] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:40.491766  6851 raft_consensus.cc:493] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.492283  6851 raft_consensus.cc:515] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
W20260709 12:26:40.494125  5710 consensus_peers.cc:597] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:40.495253  5710 leader_election.cc:336] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:40.495695  5710 leader_election.cc:304] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.494376  6851 leader_election.cc:290] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:40.491796  6854 leader_election.cc:290] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:40.498070  6854 raft_consensus.cc:2749] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:40.500496  5186 leader_election.cc:336] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
W20260709 12:26:40.500957  5710 leader_election.cc:336] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
W20260709 12:26:40.503124  5710 leader_election.cc:336] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
W20260709 12:26:40.508499  5709 leader_election.cc:336] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.509009  5709 leader_election.cc:304] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.510079  6836 raft_consensus.cc:2749] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:40.512943  5709 leader_election.cc:336] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.513528  5709 leader_election.cc:304] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.514632  6854 raft_consensus.cc:2749] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:40.524960  5187 leader_election.cc:336] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:40.525453  5187 leader_election.cc:304] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.526427  6812 raft_consensus.cc:2749] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:40.530079  5187 consensus_peers.cc:597] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:40.534358  5740 raft_consensus.cc:1275] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:40.536849  6854 raft_consensus.cc:493] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.537447  6854 raft_consensus.cc:515] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:40.539631  6854 leader_election.cc:290] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:40.542654  6851 consensus_queue.cc:1048] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:40.544734  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea368926e6346baa3b0065d3c9c510e" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:26:40.545780  5220 raft_consensus.cc:2468] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 1.
I20260709 12:26:40.547550  5711 leader_election.cc:304] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:40.548337  6854 raft_consensus.cc:2804] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:40.548735  6854 raft_consensus.cc:493] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting leader election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.549096  6854 raft_consensus.cc:3060] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:40.550163  5709 leader_election.cc:336] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.551280  6851 raft_consensus.cc:493] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.551800  6851 raft_consensus.cc:515] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:40.555154  6851 leader_election.cc:290] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:40.560870  6836 raft_consensus.cc:493] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.561543  6836 raft_consensus.cc:515] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:40.563732  6836 leader_election.cc:290] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:40.569031  6854 raft_consensus.cc:515] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:40.571902  5220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac38dc58d75468593dee0edaafb81c9" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:26:40.572582  5220 raft_consensus.cc:2468] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
I20260709 12:26:40.573472  5216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ea368926e6346baa3b0065d3c9c510e" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:40.574050  5216 raft_consensus.cc:3060] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:40.577251  5186 leader_election.cc:336] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.581187  5216 raft_consensus.cc:2468] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
W20260709 12:26:40.569096  5709 leader_election.cc:336] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.584393  5711 leader_election.cc:304] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.585341  6854 leader_election.cc:290] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:40.585935  5740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f0b7d7401864a6cadec140ae4603df6" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
I20260709 12:26:40.587812  5740 raft_consensus.cc:2468] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
I20260709 12:26:40.586340  6836 raft_consensus.cc:2804] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:40.588539  6836 raft_consensus.cc:493] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting leader election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.588996  6836 raft_consensus.cc:3060] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.590078  5711 leader_election.cc:304] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:40.590893  6855 raft_consensus.cc:2804] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.591446  6855 raft_consensus.cc:697] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
W20260709 12:26:40.592293  5709 leader_election.cc:336] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.594448  6652 raft_consensus.cc:493] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.594914  6652 raft_consensus.cc:515] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:40.592293  6855 consensus_queue.cc:237] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:40.596684  6652 leader_election.cc:290] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:40.604025  5186 leader_election.cc:304] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.607296  6652 raft_consensus.cc:2804] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:40.607662  6652 raft_consensus.cc:493] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.607998  6652 raft_consensus.cc:3060] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.606163  6836 raft_consensus.cc:515] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:40.606568  5187 leader_election.cc:336] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:40.624852  5740 raft_consensus.cc:1275] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:40.627031  6652 raft_consensus.cc:515] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:40.628888  6652 leader_election.cc:290] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:40.630105  6851 consensus_queue.cc:1048] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:40.631490  6836 leader_election.cc:290] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 election: Requested vote from peers d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
I20260709 12:26:40.634083  5216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac38dc58d75468593dee0edaafb81c9" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3"
I20260709 12:26:40.634701  5216 raft_consensus.cc:3060] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.636427  4966 catalog_manager.cc:5697] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 1 to 2, leader changed from d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:40.642067  5709 leader_election.cc:336] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
W20260709 12:26:40.648147  5186 leader_election.cc:336] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.648617  5186 leader_election.cc:304] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.644166  5216 raft_consensus.cc:2468] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 3.
I20260709 12:26:40.650748  6851 raft_consensus.cc:2749] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:40.651845  5711 leader_election.cc:304] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.653795  5740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f0b7d7401864a6cadec140ae4603df6" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b"
I20260709 12:26:40.654369  5740 raft_consensus.cc:3060] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.661963  5740 raft_consensus.cc:2468] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 2.
I20260709 12:26:40.665030  6865 raft_consensus.cc:2804] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:40.665630  6865 raft_consensus.cc:697] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [term 3 LEADER]: Becoming Leader. State: Replica: e030bb11bf104d5298a2521f8f7b206b, State: Running, Role: LEADER
I20260709 12:26:40.666585  6865 consensus_queue.cc:237] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:40.673774  6805 raft_consensus.cc:493] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:40.674387  6805 raft_consensus.cc:515] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:40.676690  6805 leader_election.cc:290] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:40.678974  5186 leader_election.cc:304] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 
I20260709 12:26:40.679824  6852 raft_consensus.cc:2804] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.680337  6852 raft_consensus.cc:697] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Becoming Leader. State: Replica: 6e72ecbdf12a4160856b2a57422118a3, State: Running, Role: LEADER
I20260709 12:26:40.681258  6852 consensus_queue.cc:237] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
W20260709 12:26:40.688154  5710 leader_election.cc:336] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
W20260709 12:26:40.690835  5186 leader_election.cc:336] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
W20260709 12:26:40.700593  5709 leader_election.cc:336] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.701145  5709 leader_election.cc:304] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.703794  6836 raft_consensus.cc:2749] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.716149  4966 catalog_manager.cc:5697] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 reported cstate change: term changed from 1 to 2, leader changed from d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) to 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67). New cstate: current_term: 2 leader_uuid: "6e72ecbdf12a4160856b2a57422118a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:40.738291  4970 catalog_manager.cc:5697] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b reported cstate change: term changed from 2 to 3, leader changed from d22f4ab7b09f42258209170e7c9214cb (127.3.200.66) to e030bb11bf104d5298a2521f8f7b206b (127.3.200.68). New cstate: current_term: 3 leader_uuid: "e030bb11bf104d5298a2521f8f7b206b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:40.857685  5186 consensus_peers.cc:597] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:40.889122  5737 raft_consensus.cc:1275] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:40.890625  6826 consensus_queue.cc:1048] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:40.904083  6826 raft_consensus.cc:493] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:40.904636  6826 raft_consensus.cc:515] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:40.906817  6826 leader_election.cc:290] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:26:40.917449  5187 leader_election.cc:336] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:40.919070  6826 raft_consensus.cc:493] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:40.919636  6826 raft_consensus.cc:515] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:40.921979  6826 leader_election.cc:290] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:26:40.926064  5186 leader_election.cc:336] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.926528  5186 leader_election.cc:304] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.927482  6652 raft_consensus.cc:2749] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:40.929688  5187 leader_election.cc:336] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
W20260709 12:26:40.937356  5186 leader_election.cc:336] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:40.937878  5186 leader_election.cc:304] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.942524  6826 raft_consensus.cc:2749] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.958012  6826 raft_consensus.cc:493] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:40.958783  6826 raft_consensus.cc:515] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:40.960469  6826 leader_election.cc:290] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:26:40.966490  5186 leader_election.cc:336] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
W20260709 12:26:40.968194  5187 leader_election.cc:336] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:40.968685  5187 leader_election.cc:304] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:40.969388  6852 raft_consensus.cc:2749] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.996857  5737 raft_consensus.cc:1275] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:40.998078  6852 consensus_queue.cc:1048] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:26:41.018982  5186 consensus_peers.cc:597] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:41.055320  5220 raft_consensus.cc:1275] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:41.056675  6836 consensus_queue.cc:1048] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:26:41.078601  5186 consensus_peers.cc:597] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:41.095369  5709 consensus_peers.cc:597] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:41.095997  5216 raft_consensus.cc:1275] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Refusing update from remote peer e030bb11bf104d5298a2521f8f7b206b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:41.097555  6855 consensus_queue.cc:1048] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:41.103579  6855 raft_consensus.cc:493] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:41.104136  6855 raft_consensus.cc:515] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:41.106245  6855 leader_election.cc:290] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:26:41.118685  5710 leader_election.cc:336] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
W20260709 12:26:41.123643  5709 leader_election.cc:336] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:41.124172  5709 leader_election.cc:304] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:41.127076  6855 raft_consensus.cc:2749] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:41.165391  5709 consensus_peers.cc:597] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:41.220319  5737 raft_consensus.cc:1275] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Refusing update from remote peer 6e72ecbdf12a4160856b2a57422118a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:41.222046  6652 consensus_queue.cc:1048] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:41.265158  6852 raft_consensus.cc:493] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:41.265692  6852 raft_consensus.cc:515] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:41.267765  6852 leader_election.cc:290] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:41.273373  6852 raft_consensus.cc:493] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:41.273851  6852 raft_consensus.cc:515] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:41.275758  6852 leader_election.cc:290] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:26:41.279630  5186 leader_election.cc:336] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
W20260709 12:26:41.290648  5187 leader_election.cc:336] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:41.291090  5187 leader_election.cc:304] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:41.297916  6852 raft_consensus.cc:2749] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:41.309140  5186 leader_election.cc:336] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
W20260709 12:26:41.320914  5186 consensus_peers.cc:597] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:41.329466  5187 leader_election.cc:336] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:41.329962  5187 leader_election.cc:304] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:41.330628  6852 raft_consensus.cc:2749] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:41.372535  5186 consensus_peers.cc:597] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:41.437104  3873 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 5169)
W20260709 12:26:41.437579  5186 consensus_peers.cc:597] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:41.464732  6855 raft_consensus.cc:493] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:41.465340  6855 raft_consensus.cc:515] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:41.468758  6855 leader_election.cc:290] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993)
W20260709 12:26:41.469509  5709 consensus_peers.cc:597] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:41.470018  5216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02feac6bfeab4925b7a3a954250788e4" candidate_uuid: "e030bb11bf104d5298a2521f8f7b206b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e72ecbdf12a4160856b2a57422118a3" is_pre_election: true
I20260709 12:26:41.470711  5216 raft_consensus.cc:2468] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e030bb11bf104d5298a2521f8f7b206b in term 2.
W20260709 12:26:41.475867  5710 leader_election.cc:336] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
W20260709 12:26:41.477541  5709 leader_election.cc:336] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:41.477986  5709 leader_election.cc:304] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:41.478734  6855 raft_consensus.cc:2749] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:41.506340  5186 consensus_peers.cc:597] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:41.517628  5709 consensus_peers.cc:597] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:41.555383  5709 consensus_peers.cc:597] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:41.584347  5186 consensus_peers.cc:597] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:41.589702  5709 consensus_peers.cc:597] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:41.620417  5709 consensus_peers.cc:597] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:41.644531  5709 consensus_peers.cc:597] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:41.660631  5186 consensus_peers.cc:597] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:41.664971  5186 consensus_peers.cc:597] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:41.702978  6826 raft_consensus.cc:493] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:41.703519  6826 raft_consensus.cc:515] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:41.705648  6826 leader_election.cc:290] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:26:41.711974  5186 leader_election.cc:336] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
W20260709 12:26:41.715078  5187 leader_election.cc:336] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:41.715489  5187 leader_election.cc:304] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:41.717010  6826 raft_consensus.cc:2749] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:41.721344  5709 consensus_peers.cc:597] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:41.738392  5709 consensus_peers.cc:597] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:41.750248  6826 raft_consensus.cc:493] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aa78544c8fb4f9cbf5ab1a935e18e82)
I20260709 12:26:41.750913  6826 raft_consensus.cc:515] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } attrs { replace: true } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:41.757107  6826 leader_election.cc:290] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067), e030bb11bf104d5298a2521f8f7b206b (127.3.200.68:43655)
I20260709 12:26:41.760493  5737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada8dc88d254884a47e7eb4f7f18244" candidate_uuid: "6e72ecbdf12a4160856b2a57422118a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e030bb11bf104d5298a2521f8f7b206b" is_pre_election: true
I20260709 12:26:41.761173  5737 raft_consensus.cc:2468] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e72ecbdf12a4160856b2a57422118a3 in term 1.
W20260709 12:26:41.764458  5186 leader_election.cc:336] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
W20260709 12:26:41.765765  5187 leader_election.cc:336] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:41.766172  5187 leader_election.cc:304] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3, e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:41.766878  6826 raft_consensus.cc:2749] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:41.769838  3873 tablet_server.cc:196] TabletServer@127.3.200.66:0 shutdown complete.
W20260709 12:26:41.859580  5709 consensus_peers.cc:597] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:41.870479  5709 consensus_peers.cc:597] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:41.884599  3873 tablet_server.cc:179] TabletServer@127.3.200.67:0 shutting down...
W20260709 12:26:41.885142  5709 consensus_peers.cc:597] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:41.892436  5711 consensus_peers.cc:597] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b -> Peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Couldn't send request to peer 6e72ecbdf12a4160856b2a57422118a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:41.908023  5711 consensus_peers.cc:597] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b -> Peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Couldn't send request to peer 6e72ecbdf12a4160856b2a57422118a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:41.916920  5710 consensus_peers.cc:597] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:41.930073  5711 consensus_peers.cc:597] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b -> Peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Couldn't send request to peer 6e72ecbdf12a4160856b2a57422118a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:41.940960  3873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:41.942000  3873 tablet_replica.cc:333] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:41.942894  3873 raft_consensus.cc:2243] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:41.943943  3873 raft_consensus.cc:2272] T 1838a7c5a8e448ff84f311a659312dff P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.946729  3873 tablet_replica.cc:333] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:41.947531  3873 raft_consensus.cc:2243] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:41.948490  3873 raft_consensus.cc:2272] T 2ebf5bf87e474e0fbdecf20901b28622 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.950953  3873 tablet_replica.cc:333] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:41.951728  3873 raft_consensus.cc:2243] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.952214  3873 raft_consensus.cc:2272] T c89d4eb4d7d548c88dc21b8bafee287e P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:41.952913  5711 consensus_peers.cc:597] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b -> Peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Couldn't send request to peer 6e72ecbdf12a4160856b2a57422118a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:41.954887  3873 tablet_replica.cc:333] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:41.955806  3873 raft_consensus.cc:2243] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:26:41.956175  5186 consensus_peers.cc:597] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:41.956782  3873 raft_consensus.cc:2272] T a3a3a987e8c145f484b2c0aa9890ed20 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.959187  3873 tablet_replica.cc:333] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:41.959986  3873 raft_consensus.cc:2243] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:41.961179  3873 raft_consensus.cc:2272] T 8f0b7d7401864a6cadec140ae4603df6 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.963748  3873 tablet_replica.cc:333] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:41.964527  3873 raft_consensus.cc:2243] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.965072  3873 raft_consensus.cc:2272] T 3a00dc8dae764febafe0efdc0fadcdac P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.967387  6826 raft_consensus.cc:493] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:41.967687  3873 tablet_replica.cc:333] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:41.967854  6826 raft_consensus.cc:515] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:41.968535  3873 raft_consensus.cc:2243] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.969206  3873 raft_consensus.cc:2272] T 3f70fcd244ec422c887a45f476de45f1 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.969712  6826 leader_election.cc:290] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:41.971611  3873 tablet_replica.cc:333] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:41.972456  3873 raft_consensus.cc:2243] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.972990  3873 raft_consensus.cc:2272] T 07469c82367d44f58e1a33659fefd477 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:41.973730  5186 leader_election.cc:336] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:41.975761  3873 tablet_replica.cc:333] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
W20260709 12:26:41.976485  5187 leader_election.cc:336] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:41.976678  3873 raft_consensus.cc:2243] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:41.977799  3873 raft_consensus.cc:2272] T 1f1a988a2c4745a2baccff62720af502 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.977095  5187 leader_election.cc:304] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:41.978580  6652 raft_consensus.cc:2749] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:41.980414  5186 consensus_peers.cc:597] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 -> Peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Couldn't send request to peer d22f4ab7b09f42258209170e7c9214cb. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:41.980623  3873 tablet_replica.cc:333] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:41.981493  3873 raft_consensus.cc:2243] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:41.982491  3873 raft_consensus.cc:2272] T d650634415db46289a46381b54dde329 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.984616  6826 raft_consensus.cc:493] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:41.985065  3873 tablet_replica.cc:333] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:41.985029  6826 raft_consensus.cc:515] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "6e72ecbdf12a4160856b2a57422118a3" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 43993 } }
I20260709 12:26:41.985869  3873 raft_consensus.cc:2243] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:41.986891  3873 raft_consensus.cc:2272] T 4eed62f347644556a405f7e6991cebf7 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.987772  6826 leader_election.cc:290] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
I20260709 12:26:41.989359  3873 tablet_replica.cc:333] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:41.990146  3873 raft_consensus.cc:2243] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:41.991052  3873 raft_consensus.cc:2272] T 97e28bbe53df40bda7a921f79ae0514f P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:41.992733  5711 consensus_peers.cc:597] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b -> Peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Couldn't send request to peer 6e72ecbdf12a4160856b2a57422118a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:41.992959  5186 leader_election.cc:336] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
I20260709 12:26:41.993597  3873 tablet_replica.cc:333] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:41.994423  3873 raft_consensus.cc:2243] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:41.994585  5187 leader_election.cc:336] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:41.994966  3873 raft_consensus.cc:2272] T 4799f16941ac411c958d31adc8dbd44a P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:41.995023  5187 leader_election.cc:304] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e72ecbdf12a4160856b2a57422118a3; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:41.995774  6826 raft_consensus.cc:2749] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:41.997634  3873 tablet_replica.cc:333] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:41.998437  3873 raft_consensus.cc:2243] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:41.998947  3873 raft_consensus.cc:2272] T 0bd4cf6677164933b892bc384682a045 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.001422  3873 tablet_replica.cc:333] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.002110  3873 raft_consensus.cc:2243] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.003008  3873 raft_consensus.cc:2272] T 4f9c81422e73491dba294f24607e5e84 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.005409  3873 tablet_replica.cc:333] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.006140  3873 raft_consensus.cc:2243] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.006631  3873 raft_consensus.cc:2272] T f863b6a5fcc24d979cc005aaef6827ae P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.008925  3873 tablet_replica.cc:333] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.009693  3873 raft_consensus.cc:2243] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.010178  3873 raft_consensus.cc:2272] T b34eeef728364ce7a688984bb7fbbb91 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.012603  3873 tablet_replica.cc:333] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.013332  3873 raft_consensus.cc:2243] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.013841  3873 raft_consensus.cc:2272] T e5b732ffbeea492c9c4d91376c781263 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.016376  3873 tablet_replica.cc:333] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.017133  3873 raft_consensus.cc:2243] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.018293  3873 raft_consensus.cc:2272] T 2f147c4f5ae9479dae2779366c7cf2fe P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.020721  3873 tablet_replica.cc:333] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.021494  3873 raft_consensus.cc:2243] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.022058  3873 raft_consensus.cc:2272] T b10627fec43d464e94516d46e5afc694 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.024597  3873 tablet_replica.cc:333] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.025333  3873 raft_consensus.cc:2243] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.026538  3873 raft_consensus.cc:2272] T b5afebfa702646d8b7372e8562e97d71 P 6e72ecbdf12a4160856b2a57422118a3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.028996  3873 tablet_replica.cc:333] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.029757  3873 raft_consensus.cc:2243] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.030227  3873 raft_consensus.cc:2272] T 45d46b792a2145b79909220733d7a533 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.032522  3873 tablet_replica.cc:333] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.033285  3873 raft_consensus.cc:2243] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.034072  3873 raft_consensus.cc:2272] T c83bfe7fc28a4548aa8923c761e8108d P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.036650  3873 tablet_replica.cc:333] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.037425  3873 raft_consensus.cc:2243] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.038349  3873 raft_consensus.cc:2272] T 8c3c3b60ecf04db989b454ae1f760212 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.040858  3873 tablet_replica.cc:333] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.041577  3873 raft_consensus.cc:2243] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.042763  3873 raft_consensus.cc:2272] T 04f60339b6c34e54bbf6e9b4a4c1e54e P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.045079  3873 tablet_replica.cc:333] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.045787  3873 raft_consensus.cc:2243] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.046609  3873 raft_consensus.cc:2272] T f6812f3677044ecba0f8e57690bef590 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.048986  3873 tablet_replica.cc:333] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.049719  3873 raft_consensus.cc:2243] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.050324  3873 raft_consensus.cc:2272] T 9ea368926e6346baa3b0065d3c9c510e P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:42.050653  5711 consensus_peers.cc:597] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b -> Peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Couldn't send request to peer 6e72ecbdf12a4160856b2a57422118a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:42.053185  3873 tablet_replica.cc:333] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.053990  3873 raft_consensus.cc:2243] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.054508  3873 raft_consensus.cc:2272] T ffee9280ebbb43bf892976cab5021757 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.057143  3873 tablet_replica.cc:333] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.057950  3873 raft_consensus.cc:2243] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.058911  3873 raft_consensus.cc:2272] T 52040c8bb853412eae96ea2727c6f8f5 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.061471  3873 tablet_replica.cc:333] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.062191  3873 raft_consensus.cc:2243] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.062685  3873 raft_consensus.cc:2272] T 47ebaac790104c1b849ecbeadadc2ac6 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.065112  3873 tablet_replica.cc:333] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.065811  3873 raft_consensus.cc:2243] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.066807  3873 raft_consensus.cc:2272] T f8da98a042af4ca9ac0ae86911498913 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.069141  3873 tablet_replica.cc:333] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.069877  3873 raft_consensus.cc:2243] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.070369  3873 raft_consensus.cc:2272] T 253cc4e85c5b4c18ac746b32b0a47e47 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.072693  3873 tablet_replica.cc:333] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.073364  3873 raft_consensus.cc:2243] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.074021  3873 raft_consensus.cc:2272] T 02feac6bfeab4925b7a3a954250788e4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.076112  3873 tablet_replica.cc:333] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.076828  3873 raft_consensus.cc:2243] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.077287  3873 raft_consensus.cc:2272] T 7ac38dc58d75468593dee0edaafb81c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.079932  3873 tablet_replica.cc:333] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.080653  3873 raft_consensus.cc:2243] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.081266  3873 raft_consensus.cc:2272] T 6ada8dc88d254884a47e7eb4f7f18244 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.083487  3873 tablet_replica.cc:333] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.084170  3873 raft_consensus.cc:2243] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.084694  3873 raft_consensus.cc:2272] T ccce9c827ef54c7fa65928fda3eb7acf P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.087044  3873 tablet_replica.cc:333] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.087720  3873 raft_consensus.cc:2243] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.088258  3873 raft_consensus.cc:2272] T 22a881bcc72945ed82bb9c3b8125ada4 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.090617  3873 tablet_replica.cc:333] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.091288  3873 raft_consensus.cc:2243] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.091766  3873 raft_consensus.cc:2272] T ec76d9e7afeb4c04b652649a01ebdc52 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.093954  3873 tablet_replica.cc:333] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.094630  3873 raft_consensus.cc:2243] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.095101  3873 raft_consensus.cc:2272] T ee33af6c31104d4abfff69a578ddc361 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.097595  3873 tablet_replica.cc:333] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.098301  3873 raft_consensus.cc:2243] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.099340  3873 raft_consensus.cc:2272] T f3892e26d8f94adabf8bd2581fee782b P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.101645  3873 tablet_replica.cc:333] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.102299  3873 raft_consensus.cc:2243] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.102758  3873 raft_consensus.cc:2272] T 4c62b8870a024d5692b8e8b85185dbd6 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.104971  3873 tablet_replica.cc:333] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.105633  3873 raft_consensus.cc:2243] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.106608  3873 raft_consensus.cc:2272] T d1704f04d7be4e899c5cf5d05207f303 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.109371  3873 tablet_replica.cc:333] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.110095  3873 raft_consensus.cc:2243] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.110816  3873 raft_consensus.cc:2272] T d4c6522d7db94a48b906c63f7c31b8e6 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.113476  3873 tablet_replica.cc:333] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.114267  3873 raft_consensus.cc:2243] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.114868  3873 raft_consensus.cc:2272] T c872a85641bb42caaf228b2eeeafcc93 P 6e72ecbdf12a4160856b2a57422118a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.117487  3873 tablet_replica.cc:333] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.118134  3873 raft_consensus.cc:2243] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.119041  3873 raft_consensus.cc:2272] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P 6e72ecbdf12a4160856b2a57422118a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.121361  3873 tablet_replica.cc:333] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3: stopping tablet replica
I20260709 12:26:42.121907  3873 raft_consensus.cc:2243] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.122920  3873 raft_consensus.cc:2272] T 500a5a8d445949f0b0d635fd3820f5c9 P 6e72ecbdf12a4160856b2a57422118a3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:42.130260  5710 consensus_peers.cc:597] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:42.157068  6836 raft_consensus.cc:493] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:42.157538  6836 raft_consensus.cc:515] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:42.159179  6836 leader_election.cc:290] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:26:42.163645  5709 leader_election.cc:336] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
W20260709 12:26:42.165755  5710 leader_election.cc:336] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:42.166162  5710 leader_election.cc:304] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:42.166740  6836 raft_consensus.cc:2749] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:42.204025  5711 consensus_peers.cc:597] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b -> Peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Couldn't send request to peer 6e72ecbdf12a4160856b2a57422118a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:42.225999  3873 tablet_server.cc:196] TabletServer@127.3.200.67:0 shutdown complete.
W20260709 12:26:42.255007  5711 consensus_peers.cc:597] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b -> Peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Couldn't send request to peer 6e72ecbdf12a4160856b2a57422118a3. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.67:43993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:42.315997  5710 consensus_peers.cc:597] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:42.316391  6836 raft_consensus.cc:493] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d22f4ab7b09f42258209170e7c9214cb)
I20260709 12:26:42.316926  6836 raft_consensus.cc:515] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aa78544c8fb4f9cbf5ab1a935e18e82" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 37149 } } peers { permanent_uuid: "d22f4ab7b09f42258209170e7c9214cb" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 37067 } } peers { permanent_uuid: "e030bb11bf104d5298a2521f8f7b206b" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 43655 } attrs { promote: false } }
I20260709 12:26:42.320899  6836 leader_election.cc:290] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149), d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067)
W20260709 12:26:42.323515  5709 leader_election.cc:336] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d22f4ab7b09f42258209170e7c9214cb (127.3.200.66:37067): Network error: Client connection negotiation failed: client connection to 127.3.200.66:37067: connect: Connection refused (error 111)
W20260709 12:26:42.324057  5710 leader_election.cc:336] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111)
I20260709 12:26:42.324494  5710 leader_election.cc:304] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e030bb11bf104d5298a2521f8f7b206b; no voters: 0aa78544c8fb4f9cbf5ab1a935e18e82, d22f4ab7b09f42258209170e7c9214cb
I20260709 12:26:42.325525  6836 raft_consensus.cc:2749] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:42.343932  5711 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.200.67:43993: connect: Connection refused (error 111) [suppressed 527 similar messages]
W20260709 12:26:42.346608  5711 consensus_peers.cc:597] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b -> Peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Couldn't send request to peer 6e72ecbdf12a4160856b2a57422118a3. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.67:43993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:42.350821  3873 tablet_server.cc:179] TabletServer@127.3.200.68:0 shutting down...
W20260709 12:26:42.359419  5711 consensus_peers.cc:597] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b -> Peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Couldn't send request to peer 6e72ecbdf12a4160856b2a57422118a3. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.67:43993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:42.407219  5710 consensus_peers.cc:597] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:42.411773  3873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:42.412539  3873 tablet_replica.cc:333] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.413242  3873 raft_consensus.cc:2243] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.413740  3873 raft_consensus.cc:2272] T b5afebfa702646d8b7372e8562e97d71 P e030bb11bf104d5298a2521f8f7b206b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.415647  3873 tablet_replica.cc:333] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.416261  3873 raft_consensus.cc:2243] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.416934  3873 raft_consensus.cc:2272] T d650634415db46289a46381b54dde329 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.419327  3873 tablet_replica.cc:333] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.419971  3873 raft_consensus.cc:2243] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.420993  3873 raft_consensus.cc:2272] T 7ac38dc58d75468593dee0edaafb81c9 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:42.421639  5711 consensus_peers.cc:597] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b -> Peer 6e72ecbdf12a4160856b2a57422118a3 (127.3.200.67:43993): Couldn't send request to peer 6e72ecbdf12a4160856b2a57422118a3. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.67:43993: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:42.423130  3873 tablet_replica.cc:333] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.423743  3873 raft_consensus.cc:2243] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.424324  3873 raft_consensus.cc:2272] T bb629cfc440b4e6f8d2ab3ea5e5cba62 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.426169  3873 tablet_replica.cc:333] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.426733  3873 raft_consensus.cc:2243] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.427451  3873 raft_consensus.cc:2272] T c872a85641bb42caaf228b2eeeafcc93 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.429543  3873 tablet_replica.cc:333] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.430275  3873 raft_consensus.cc:2243] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.430850  3873 raft_consensus.cc:2272] T 7292f06cb5514a80849fe386d1f5edd5 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.433326  3873 tablet_replica.cc:333] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.433992  3873 raft_consensus.cc:2243] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.434881  3873 raft_consensus.cc:2272] T 3f70fcd244ec422c887a45f476de45f1 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.437331  3873 tablet_replica.cc:333] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.438030  3873 raft_consensus.cc:2243] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.438536  3873 raft_consensus.cc:2272] T cdc3c77d7a1a4a4c9cf2c6405234815d P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.440116  3873 tablet_replica.cc:333] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.440716  3873 raft_consensus.cc:2243] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.441201  3873 raft_consensus.cc:2272] T 2f147c4f5ae9479dae2779366c7cf2fe P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.442857  3873 tablet_replica.cc:333] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.443363  3873 raft_consensus.cc:2243] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.443771  3873 raft_consensus.cc:2272] T a3a3a987e8c145f484b2c0aa9890ed20 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.445648  3873 tablet_replica.cc:333] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.446184  3873 raft_consensus.cc:2243] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.446899  3873 raft_consensus.cc:2272] T 89a90aff4ede48ad8c6ef5d2ca6c1a5c P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.448714  3873 tablet_replica.cc:333] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.449229  3873 raft_consensus.cc:2243] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.449666  3873 raft_consensus.cc:2272] T f424fe8428004213860887c1e4ed5796 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.451429  3873 tablet_replica.cc:333] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.451941  3873 raft_consensus.cc:2243] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.452432  3873 raft_consensus.cc:2272] T d1704f04d7be4e899c5cf5d05207f303 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.454147  3873 tablet_replica.cc:333] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.454685  3873 raft_consensus.cc:2243] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.455387  3873 raft_consensus.cc:2272] T 4c62b8870a024d5692b8e8b85185dbd6 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.457226  3873 tablet_replica.cc:333] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.457769  3873 raft_consensus.cc:2243] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.458532  3873 raft_consensus.cc:2272] T 56941204ae3e40bba5254fad3092ebeb P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.460443  3873 tablet_replica.cc:333] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.461103  3873 raft_consensus.cc:2243] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.461849  3873 raft_consensus.cc:2272] T ffee9280ebbb43bf892976cab5021757 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.463748  3873 tablet_replica.cc:333] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.464275  3873 raft_consensus.cc:2243] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.465065  3873 raft_consensus.cc:2272] T f863b6a5fcc24d979cc005aaef6827ae P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.466920  3873 tablet_replica.cc:333] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.467468  3873 raft_consensus.cc:2243] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.467924  3873 raft_consensus.cc:2272] T 04f60339b6c34e54bbf6e9b4a4c1e54e P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.469682  3873 tablet_replica.cc:333] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.470242  3873 raft_consensus.cc:2243] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.470709  3873 raft_consensus.cc:2272] T 8c3c3b60ecf04db989b454ae1f760212 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.472473  3873 tablet_replica.cc:333] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.473045  3873 raft_consensus.cc:2243] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.473556  3873 raft_consensus.cc:2272] T 500a5a8d445949f0b0d635fd3820f5c9 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.475191  3873 tablet_replica.cc:333] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.475706  3873 raft_consensus.cc:2243] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.476161  3873 raft_consensus.cc:2272] T f3892e26d8f94adabf8bd2581fee782b P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.477967  3873 tablet_replica.cc:333] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.478479  3873 raft_consensus.cc:2243] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.478924  3873 raft_consensus.cc:2272] T 02feac6bfeab4925b7a3a954250788e4 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.480609  3873 tablet_replica.cc:333] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.481119  3873 raft_consensus.cc:2243] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.481595  3873 raft_consensus.cc:2272] T 22b25036e425414d9ac336d8b3074769 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.483335  3873 tablet_replica.cc:333] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.483868  3873 raft_consensus.cc:2243] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.484596  3873 raft_consensus.cc:2272] T 47ebaac790104c1b849ecbeadadc2ac6 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.486231  3873 tablet_replica.cc:333] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.486799  3873 raft_consensus.cc:2243] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.487625  3873 raft_consensus.cc:2272] T d4c6522d7db94a48b906c63f7c31b8e6 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.489370  3873 tablet_replica.cc:333] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.489876  3873 raft_consensus.cc:2243] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.490289  3873 raft_consensus.cc:2272] T f8da98a042af4ca9ac0ae86911498913 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.491967  3873 tablet_replica.cc:333] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.492503  3873 raft_consensus.cc:2243] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.493034  3873 raft_consensus.cc:2272] T 2ebf5bf87e474e0fbdecf20901b28622 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.494910  3873 tablet_replica.cc:333] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.495447  3873 raft_consensus.cc:2243] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.496253  3873 raft_consensus.cc:2272] T 23c924d344cb49639d42d3f21aa08cf2 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.498206  3873 tablet_replica.cc:333] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.498739  3873 raft_consensus.cc:2243] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.499248  3873 raft_consensus.cc:2272] T 04afa18a0a324c0d9788a17d1182585b P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.501170  3873 tablet_replica.cc:333] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.501694  3873 raft_consensus.cc:2243] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.502220  3873 raft_consensus.cc:2272] T 4eed62f347644556a405f7e6991cebf7 P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.504006  3873 tablet_replica.cc:333] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.504545  3873 raft_consensus.cc:2243] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.505362  3873 raft_consensus.cc:2272] T 9ea368926e6346baa3b0065d3c9c510e P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.507117  3873 tablet_replica.cc:333] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.507648  3873 raft_consensus.cc:2243] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.508363  3873 raft_consensus.cc:2272] T 4799f16941ac411c958d31adc8dbd44a P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.510263  3873 tablet_replica.cc:333] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.510855  3873 raft_consensus.cc:2243] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.511593  3873 raft_consensus.cc:2272] T b10627fec43d464e94516d46e5afc694 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.513424  3873 tablet_replica.cc:333] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.513935  3873 raft_consensus.cc:2243] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.514369  3873 raft_consensus.cc:2272] T 73298cac061840a88d6e43468fbb541d P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.516522  3873 tablet_replica.cc:333] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.517302  3873 raft_consensus.cc:2243] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.517966  3873 raft_consensus.cc:2272] T 1838a7c5a8e448ff84f311a659312dff P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.520341  3873 tablet_replica.cc:333] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
W20260709 12:26:42.520205  5710 consensus_peers.cc:597] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b -> Peer 0aa78544c8fb4f9cbf5ab1a935e18e82 (127.3.200.65:37149): Couldn't send request to peer 0aa78544c8fb4f9cbf5ab1a935e18e82. Status: Network error: Client connection negotiation failed: client connection to 127.3.200.65:37149: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:42.521000  3873 raft_consensus.cc:2243] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.521467  3873 raft_consensus.cc:2272] T 6ada8dc88d254884a47e7eb4f7f18244 P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.523088  3873 tablet_replica.cc:333] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.523612  3873 raft_consensus.cc:2243] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.524349  3873 raft_consensus.cc:2272] T 3a00dc8dae764febafe0efdc0fadcdac P e030bb11bf104d5298a2521f8f7b206b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.526052  3873 tablet_replica.cc:333] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.526551  3873 raft_consensus.cc:2243] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.527016  3873 raft_consensus.cc:2272] T 8f0b7d7401864a6cadec140ae4603df6 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.528730  3873 tablet_replica.cc:333] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.529212  3873 raft_consensus.cc:2243] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.529923  3873 raft_consensus.cc:2272] T 5d91e17c8c3b4cac9a128316050ce7df P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.531672  3873 tablet_replica.cc:333] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.532145  3873 raft_consensus.cc:2243] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.532886  3873 raft_consensus.cc:2272] T 034ac3e487504f54ac6e50430a0b22d7 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.534643  3873 tablet_replica.cc:333] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.535137  3873 raft_consensus.cc:2243] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.535668  3873 raft_consensus.cc:2272] T 97e28bbe53df40bda7a921f79ae0514f P e030bb11bf104d5298a2521f8f7b206b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.537508  3873 tablet_replica.cc:333] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.538007  3873 raft_consensus.cc:2243] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.538811  3873 raft_consensus.cc:2272] T d1640ee2f62349858037e353ecde48d8 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.540519  3873 tablet_replica.cc:333] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b: stopping tablet replica
I20260709 12:26:42.541029  3873 raft_consensus.cc:2243] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.541774  3873 raft_consensus.cc:2272] T 5b00d99b54ae4fda8d58410ef0b5c3e3 P e030bb11bf104d5298a2521f8f7b206b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.604614  3873 tablet_server.cc:196] TabletServer@127.3.200.68:0 shutdown complete.
I20260709 12:26:42.670296  3873 master.cc:562] Master@127.3.200.126:42719 shutting down...
W20260709 12:26:42.701807  5018 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:26:42.702075  5018 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:26:42.702292  5018 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 12:26:42.704767  3873 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.705281  3873 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.705556  3873 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0b37addd7ee64e1680b0efd2b27b9300: stopping tablet replica
I20260709 12:26:42.728086  3873 master.cc:584] Master@127.3.200.126:42719 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (57824 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:26:42.828100  3873 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.200.126:32897
I20260709 12:26:42.829572  3873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:42.835273  6889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:42.835764  6890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:42.836215  6892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:42.836489  3873 server_base.cc:1061] running on GCE node
I20260709 12:26:42.837894  3873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:42.838094  3873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:42.838274  3873 hybrid_clock.cc:648] HybridClock initialized: now 1783600002838242 us; error 0 us; skew 500 ppm
I20260709 12:26:42.838811  3873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:42.841239  3873 webserver.cc:533] Webserver started at http://127.3.200.126:34669/ using document root <none> and password file <none>
I20260709 12:26:42.841728  3873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:42.841913  3873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:42.842201  3873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:42.843262  3873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/master-0-root/instance:
uuid: "05f3d75cd2f646f485ea66030f036974"
format_stamp: "Formatted at 2026-07-09 12:26:42 on dist-test-slave-px1m"
I20260709 12:26:42.847707  3873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.005s
I20260709 12:26:42.851002  6897 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:42.851965  3873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:42.852394  3873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/master-0-root
uuid: "05f3d75cd2f646f485ea66030f036974"
format_stamp: "Formatted at 2026-07-09 12:26:42 on dist-test-slave-px1m"
I20260709 12:26:42.852777  3873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:42.881649  3873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:42.883018  3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:42.921418  3873 rpc_server.cc:307] RPC server started. Bound to: 127.3.200.126:32897
I20260709 12:26:42.921520  6948 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.200.126:32897 every 8 connection(s)
I20260709 12:26:42.925352  6949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.935209  6949 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974: Bootstrap starting.
I20260709 12:26:42.940023  6949 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.944237  6949 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974: No bootstrap required, opened a new log
I20260709 12:26:42.946435  6949 raft_consensus.cc:359] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05f3d75cd2f646f485ea66030f036974" member_type: VOTER }
I20260709 12:26:42.946827  6949 raft_consensus.cc:385] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.947100  6949 raft_consensus.cc:740] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f3d75cd2f646f485ea66030f036974, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.947749  6949 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05f3d75cd2f646f485ea66030f036974" member_type: VOTER }
I20260709 12:26:42.948205  6949 raft_consensus.cc:399] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:42.948422  6949 raft_consensus.cc:493] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:42.948689  6949 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.954891  6949 raft_consensus.cc:515] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05f3d75cd2f646f485ea66030f036974" member_type: VOTER }
I20260709 12:26:42.955490  6949 leader_election.cc:304] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05f3d75cd2f646f485ea66030f036974; no voters: 
I20260709 12:26:42.956899  6949 leader_election.cc:290] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:42.957201  6952 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:42.958551  6952 raft_consensus.cc:697] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974 [term 1 LEADER]: Becoming Leader. State: Replica: 05f3d75cd2f646f485ea66030f036974, State: Running, Role: LEADER
I20260709 12:26:42.959246  6952 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05f3d75cd2f646f485ea66030f036974" member_type: VOTER }
I20260709 12:26:42.959741  6949 sys_catalog.cc:565] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:42.963452  6953 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05f3d75cd2f646f485ea66030f036974" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05f3d75cd2f646f485ea66030f036974" member_type: VOTER } }
I20260709 12:26:42.964021  6953 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:42.964831  6954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05f3d75cd2f646f485ea66030f036974. Latest consensus state: current_term: 1 leader_uuid: "05f3d75cd2f646f485ea66030f036974" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05f3d75cd2f646f485ea66030f036974" member_type: VOTER } }
I20260709 12:26:42.965515  6954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:42.975762  6959 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:42.983400  6959 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:42.984408  3873 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:42.992516  6959 catalog_manager.cc:1383] Generated new cluster ID: 0630ed10adb74e9b9f863d7e1600562f
I20260709 12:26:42.992878  6959 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:43.014287  6959 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:43.015587  6959 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:43.027940  6959 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974: Generated new TSK 0
I20260709 12:26:43.028599  6959 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:43.050781  3873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:43.057077  6970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:43.058120  6971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:43.060730  3873 server_base.cc:1061] running on GCE node
W20260709 12:26:43.060770  6973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:43.062260  3873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:43.062462  3873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:43.062623  3873 hybrid_clock.cc:648] HybridClock initialized: now 1783600003062608 us; error 0 us; skew 500 ppm
I20260709 12:26:43.063263  3873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:43.065542  3873 webserver.cc:533] Webserver started at http://127.3.200.65:43779/ using document root <none> and password file <none>
I20260709 12:26:43.066022  3873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:43.066215  3873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:43.066497  3873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:43.067552  3873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-0-root/instance:
uuid: "2c146bd91ab94c5191365c34a414a5e6"
format_stamp: "Formatted at 2026-07-09 12:26:43 on dist-test-slave-px1m"
I20260709 12:26:43.071853  3873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:26:43.075135  6978 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:43.075881  3873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
I20260709 12:26:43.076198  3873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-0-root
uuid: "2c146bd91ab94c5191365c34a414a5e6"
format_stamp: "Formatted at 2026-07-09 12:26:43 on dist-test-slave-px1m"
I20260709 12:26:43.076489  3873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:43.103204  3873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:43.104418  3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:43.105985  3873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:43.108307  3873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:43.108580  3873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:43.108850  3873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:43.109038  3873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:43.149436  3873 rpc_server.cc:307] RPC server started. Bound to: 127.3.200.65:34921
I20260709 12:26:43.149540  7040 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.200.65:34921 every 8 connection(s)
I20260709 12:26:43.154606  3873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:43.161448  7045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:43.161783  7046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:43.166082  7048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:43.166255  3873 server_base.cc:1061] running on GCE node
I20260709 12:26:43.167840  3873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:43.168054  3873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:43.168300  3873 hybrid_clock.cc:648] HybridClock initialized: now 1783600003168278 us; error 0 us; skew 500 ppm
I20260709 12:26:43.168912  3873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:43.171900  3873 webserver.cc:533] Webserver started at http://127.3.200.66:38369/ using document root <none> and password file <none>
I20260709 12:26:43.172641  3873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:43.172900  3873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:43.173234  3873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:43.174451  7041 heartbeater.cc:344] Connected to a master server at 127.3.200.126:32897
I20260709 12:26:43.174623  3873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-1-root/instance:
uuid: "9e6e5c8ad44447588681b10df7ad79ca"
format_stamp: "Formatted at 2026-07-09 12:26:43 on dist-test-slave-px1m"
I20260709 12:26:43.174958  7041 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:43.175972  7041 heartbeater.cc:507] Master 127.3.200.126:32897 requested a full tablet report, sending...
I20260709 12:26:43.178563  6914 ts_manager.cc:194] Registered new tserver with Master: 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:43.181155  6914 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48270
I20260709 12:26:43.181345  3873 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:26:43.185806  7053 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:43.186542  3873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:26:43.186857  3873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-1-root
uuid: "9e6e5c8ad44447588681b10df7ad79ca"
format_stamp: "Formatted at 2026-07-09 12:26:43 on dist-test-slave-px1m"
I20260709 12:26:43.187155  3873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:43.196480  3873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:43.197641  3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:43.199007  3873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:43.201184  3873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:43.201395  3873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:43.201622  3873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:43.201785  3873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:43.241227  3873 rpc_server.cc:307] RPC server started. Bound to: 127.3.200.66:36713
I20260709 12:26:43.241338  7115 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.200.66:36713 every 8 connection(s)
I20260709 12:26:43.245908  3873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:43.253069  7119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:43.254864  7120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:43.256217  3873 server_base.cc:1061] running on GCE node
W20260709 12:26:43.258322  7122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:43.259140  7116 heartbeater.cc:344] Connected to a master server at 127.3.200.126:32897
I20260709 12:26:43.259476  3873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:26:43.259543  7116 heartbeater.cc:461] Registering TS with master...
W20260709 12:26:43.259827  3873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:43.260049  3873 hybrid_clock.cc:648] HybridClock initialized: now 1783600003260030 us; error 0 us; skew 500 ppm
I20260709 12:26:43.260505  7116 heartbeater.cc:507] Master 127.3.200.126:32897 requested a full tablet report, sending...
I20260709 12:26:43.260726  3873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:43.262760  6914 ts_manager.cc:194] Registered new tserver with Master: 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:43.263827  3873 webserver.cc:533] Webserver started at http://127.3.200.67:35087/ using document root <none> and password file <none>
I20260709 12:26:43.264382  3873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:43.264317  6914 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48276
I20260709 12:26:43.264755  3873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:43.265067  3873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:43.266382  3873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-2-root/instance:
uuid: "022925662268440c91fff7e8732d7a0b"
format_stamp: "Formatted at 2026-07-09 12:26:43 on dist-test-slave-px1m"
I20260709 12:26:43.271026  3873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:26:43.274367  7127 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:43.275163  3873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:26:43.275519  3873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-2-root
uuid: "022925662268440c91fff7e8732d7a0b"
format_stamp: "Formatted at 2026-07-09 12:26:43 on dist-test-slave-px1m"
I20260709 12:26:43.275867  3873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:43.300212  3873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:43.301470  3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:43.302973  3873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:43.305270  3873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:43.305505  3873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:43.305759  3873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:43.305929  3873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:43.346990  3873 rpc_server.cc:307] RPC server started. Bound to: 127.3.200.67:39437
I20260709 12:26:43.347080  7189 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.200.67:39437 every 8 connection(s)
I20260709 12:26:43.351817  3873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:43.359040  7193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:43.361315  7194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:43.362941  3873 server_base.cc:1061] running on GCE node
W20260709 12:26:43.363835  7196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:43.364969  3873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:43.365211  3873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:43.365391  3873 hybrid_clock.cc:648] HybridClock initialized: now 1783600003365373 us; error 0 us; skew 500 ppm
I20260709 12:26:43.365712  7190 heartbeater.cc:344] Connected to a master server at 127.3.200.126:32897
I20260709 12:26:43.366065  3873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:43.366132  7190 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:43.366927  7190 heartbeater.cc:507] Master 127.3.200.126:32897 requested a full tablet report, sending...
I20260709 12:26:43.369154  3873 webserver.cc:533] Webserver started at http://127.3.200.68:43167/ using document root <none> and password file <none>
I20260709 12:26:43.369163  6914 ts_manager.cc:194] Registered new tserver with Master: 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:43.369812  3873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:43.370062  3873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:43.370333  3873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:43.371122  6914 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48280
I20260709 12:26:43.371474  3873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-3-root/instance:
uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
format_stamp: "Formatted at 2026-07-09 12:26:43 on dist-test-slave-px1m"
I20260709 12:26:43.376842  3873 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.006s
I20260709 12:26:43.380959  7201 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:43.381743  3873 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:26:43.382035  3873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-3-root
uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
format_stamp: "Formatted at 2026-07-09 12:26:43 on dist-test-slave-px1m"
I20260709 12:26:43.382295  3873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskddcSUg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599884178482-3873-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:43.402978  3873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:43.404235  3873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:43.405782  3873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:43.408124  3873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:43.408432  3873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:43.408744  3873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:43.408968  3873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:43.450013  3873 rpc_server.cc:307] RPC server started. Bound to: 127.3.200.68:38743
I20260709 12:26:43.450098  7263 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.200.68:38743 every 8 connection(s)
I20260709 12:26:43.465406  7264 heartbeater.cc:344] Connected to a master server at 127.3.200.126:32897
I20260709 12:26:43.465803  7264 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:43.466531  7264 heartbeater.cc:507] Master 127.3.200.126:32897 requested a full tablet report, sending...
I20260709 12:26:43.468395  6914 ts_manager.cc:194] Registered new tserver with Master: e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:43.468717  3873 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01539812s
I20260709 12:26:43.470085  6914 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48294
I20260709 12:26:43.506654  6914 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48306:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:26:43.748541  7081 tablet_service.cc:1511] Processing CreateTablet for tablet 2e8ea56c97614b3c978c9b2d55e10c1d (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:43.750589  7081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e8ea56c97614b3c978c9b2d55e10c1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.753971  7080 tablet_service.cc:1511] Processing CreateTablet for tablet 77b568a9d33646ddab98b1429efa026e (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:43.755954  7080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b568a9d33646ddab98b1429efa026e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.762168  7079 tablet_service.cc:1511] Processing CreateTablet for tablet bbef1c76ff7d498c80d88abdea210535 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:43.764282  7079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbef1c76ff7d498c80d88abdea210535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.769855  7155 tablet_service.cc:1511] Processing CreateTablet for tablet 2e8ea56c97614b3c978c9b2d55e10c1d (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:43.771325  7155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e8ea56c97614b3c978c9b2d55e10c1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.773002  7154 tablet_service.cc:1511] Processing CreateTablet for tablet 8e234c90d1214131938d5c23c9ace832 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:43.774472  7154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e234c90d1214131938d5c23c9ace832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.775099  7152 tablet_service.cc:1511] Processing CreateTablet for tablet b98e3324314348f5912ad5e8121127a8 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:43.776448  7152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b98e3324314348f5912ad5e8121127a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.777854  7153 tablet_service.cc:1511] Processing CreateTablet for tablet bbef1c76ff7d498c80d88abdea210535 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:43.778805  7006 tablet_service.cc:1511] Processing CreateTablet for tablet 2e8ea56c97614b3c978c9b2d55e10c1d (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:43.779321  7153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbef1c76ff7d498c80d88abdea210535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.780189  7006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e8ea56c97614b3c978c9b2d55e10c1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.780478  7151 tablet_service.cc:1511] Processing CreateTablet for tablet 6d4ca6181724464a84e2f73d387bb002 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:43.782030  7151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d4ca6181724464a84e2f73d387bb002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.781791  7005 tablet_service.cc:1511] Processing CreateTablet for tablet 77b568a9d33646ddab98b1429efa026e (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:43.782394  7078 tablet_service.cc:1511] Processing CreateTablet for tablet b98e3324314348f5912ad5e8121127a8 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:43.783128  7005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b568a9d33646ddab98b1429efa026e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.783802  7078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b98e3324314348f5912ad5e8121127a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.785691  7004 tablet_service.cc:1511] Processing CreateTablet for tablet 8e234c90d1214131938d5c23c9ace832 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:43.787038  7004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e234c90d1214131938d5c23c9ace832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.787132  7150 tablet_service.cc:1511] Processing CreateTablet for tablet 92f8dcbe1b0441da8488ac2bd01c93fe (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:43.788713  7150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f8dcbe1b0441da8488ac2bd01c93fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.789602  7003 tablet_service.cc:1511] Processing CreateTablet for tablet b98e3324314348f5912ad5e8121127a8 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:43.790870  7003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b98e3324314348f5912ad5e8121127a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.793658  7002 tablet_service.cc:1511] Processing CreateTablet for tablet 5441bfff9f464980afe37a60473c5165 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:43.794998  7002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5441bfff9f464980afe37a60473c5165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.800488  7149 tablet_service.cc:1511] Processing CreateTablet for tablet d6eb6cab9bda4770b44ece4d2a9351eb (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:43.806047  7001 tablet_service.cc:1511] Processing CreateTablet for tablet 6d4ca6181724464a84e2f73d387bb002 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:43.806845  7149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6eb6cab9bda4770b44ece4d2a9351eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.807475  7001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d4ca6181724464a84e2f73d387bb002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.801697  7077 tablet_service.cc:1511] Processing CreateTablet for tablet 5441bfff9f464980afe37a60473c5165 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:43.810051  7077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5441bfff9f464980afe37a60473c5165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.811972  6998 tablet_service.cc:1511] Processing CreateTablet for tablet 807e3a465242486abefc80481a598bf9 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:43.802301  7075 tablet_service.cc:1511] Processing CreateTablet for tablet d6eb6cab9bda4770b44ece4d2a9351eb (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:43.813396  6998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 807e3a465242486abefc80481a598bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.813956  7075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6eb6cab9bda4770b44ece4d2a9351eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.803025  7076 tablet_service.cc:1511] Processing CreateTablet for tablet 92f8dcbe1b0441da8488ac2bd01c93fe (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:43.818104  7076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f8dcbe1b0441da8488ac2bd01c93fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.818244  6997 tablet_service.cc:1511] Processing CreateTablet for tablet 798483090bd74738a29fe018ce19422f (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:43.819730  6997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798483090bd74738a29fe018ce19422f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.804188  7074 tablet_service.cc:1511] Processing CreateTablet for tablet dc12a1d7cc98405390715e3d66ca06f7 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:43.805022  7000 tablet_service.cc:1511] Processing CreateTablet for tablet d6eb6cab9bda4770b44ece4d2a9351eb (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:43.822003  7074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc12a1d7cc98405390715e3d66ca06f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.822149  7000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6eb6cab9bda4770b44ece4d2a9351eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.809665  6999 tablet_service.cc:1511] Processing CreateTablet for tablet dc12a1d7cc98405390715e3d66ca06f7 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:43.805343  7073 tablet_service.cc:1511] Processing CreateTablet for tablet c6cce034dc624ce997cbf455d69ec9b2 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:43.825397  6999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc12a1d7cc98405390715e3d66ca06f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.825564  7073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6cce034dc624ce997cbf455d69ec9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.838182  7072 tablet_service.cc:1511] Processing CreateTablet for tablet 798483090bd74738a29fe018ce19422f (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:43.839668  7072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798483090bd74738a29fe018ce19422f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.854954  7148 tablet_service.cc:1511] Processing CreateTablet for tablet 807e3a465242486abefc80481a598bf9 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:43.856582  7148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 807e3a465242486abefc80481a598bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.862936  7147 tablet_service.cc:1511] Processing CreateTablet for tablet c6cce034dc624ce997cbf455d69ec9b2 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:43.864466  7147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6cce034dc624ce997cbf455d69ec9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.884299  7146 tablet_service.cc:1511] Processing CreateTablet for tablet 798483090bd74738a29fe018ce19422f (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:43.885797  7146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798483090bd74738a29fe018ce19422f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.899480  7079 tablet_service.cc:1511] Processing CreateTablet for tablet afc5926243c0439fb58fe23dcbd604a1 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:43.904949  7284 tablet_bootstrap.cc:492] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:43.910039  7078 tablet_service.cc:1511] Processing CreateTablet for tablet 647e97c99a2a4c41a8f6e6570074411f (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:43.911890  7154 tablet_service.cc:1511] Processing CreateTablet for tablet 647e97c99a2a4c41a8f6e6570074411f (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:43.914294  7154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 647e97c99a2a4c41a8f6e6570074411f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.917641  7081 tablet_service.cc:1511] Processing CreateTablet for tablet 01d6818d6b1045378a6b8ace92ed2d7d (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:43.919620  7079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc5926243c0439fb58fe23dcbd604a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.926754  7080 tablet_service.cc:1511] Processing CreateTablet for tablet 9456d7a00cec43ee9987067a28b4d6b8 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:43.928212  7080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9456d7a00cec43ee9987067a28b4d6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.933343  7284 tablet_bootstrap.cc:654] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.940925  7078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 647e97c99a2a4c41a8f6e6570074411f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.944918  7081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d6818d6b1045378a6b8ace92ed2d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:43.957644  7155 tablet_service.cc:1511] Processing CreateTablet for tablet dd176d00420245edb709bcf50d2ce27b (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:43.959048  7155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd176d00420245edb709bcf50d2ce27b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:43.970829  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:43.974045  7073 tablet_service.cc:1511] Processing CreateTablet for tablet 695b83e20b7a40e29be9f4c9b00baaaa (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:44.005281  7073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 695b83e20b7a40e29be9f4c9b00baaaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.013307  7228 tablet_service.cc:1511] Processing CreateTablet for tablet 8e234c90d1214131938d5c23c9ace832 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:44.014667  7228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e234c90d1214131938d5c23c9ace832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.015211  7225 tablet_service.cc:1511] Processing CreateTablet for tablet 6d4ca6181724464a84e2f73d387bb002 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:44.017656  7000 tablet_service.cc:1511] Processing CreateTablet for tablet 01d6818d6b1045378a6b8ace92ed2d7d (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:44.017787  7224 tablet_service.cc:1511] Processing CreateTablet for tablet 92f8dcbe1b0441da8488ac2bd01c93fe (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:44.019182  7000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d6818d6b1045378a6b8ace92ed2d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.019006  7226 tablet_service.cc:1511] Processing CreateTablet for tablet 5441bfff9f464980afe37a60473c5165 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:44.020190  7223 tablet_service.cc:1511] Processing CreateTablet for tablet dc12a1d7cc98405390715e3d66ca06f7 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:44.012084  7229 tablet_service.cc:1511] Processing CreateTablet for tablet 77b568a9d33646ddab98b1429efa026e (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:44.021265  7222 tablet_service.cc:1511] Processing CreateTablet for tablet 807e3a465242486abefc80481a598bf9 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:44.017789  7227 tablet_service.cc:1511] Processing CreateTablet for tablet bbef1c76ff7d498c80d88abdea210535 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:44.023129  7221 tablet_service.cc:1511] Processing CreateTablet for tablet c6cce034dc624ce997cbf455d69ec9b2 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:44.025445  7220 tablet_service.cc:1511] Processing CreateTablet for tablet afc5926243c0439fb58fe23dcbd604a1 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:44.027428  7147 tablet_service.cc:1511] Processing CreateTablet for tablet 01d6818d6b1045378a6b8ace92ed2d7d (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:43.991619  7004 tablet_service.cc:1511] Processing CreateTablet for tablet afc5926243c0439fb58fe23dcbd604a1 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:44.029847  7004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc5926243c0439fb58fe23dcbd604a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.030503  7225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d4ca6181724464a84e2f73d387bb002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.030373  7154 tablet_service.cc:1511] Processing CreateTablet for tablet b3af91840ca144a7b9595ccb5dfd4527 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:44.012059  7002 tablet_service.cc:1511] Processing CreateTablet for tablet dd176d00420245edb709bcf50d2ce27b (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:44.037917  7002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd176d00420245edb709bcf50d2ce27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.039633  7150 tablet_service.cc:1511] Processing CreateTablet for tablet 695b83e20b7a40e29be9f4c9b00baaaa (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:44.046941  7148 tablet_service.cc:1511] Processing CreateTablet for tablet d91aac6ef8734a52b667a6fd42f01635 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:44.050614  6999 tablet_service.cc:1511] Processing CreateTablet for tablet 9456d7a00cec43ee9987067a28b4d6b8 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:44.068739  7076 tablet_service.cc:1511] Processing CreateTablet for tablet d91aac6ef8734a52b667a6fd42f01635 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:44.070175  7076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d91aac6ef8734a52b667a6fd42f01635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.054066  7146 tablet_service.cc:1511] Processing CreateTablet for tablet 7a9b67ee02db405787e857725c431127 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:44.061868  7005 tablet_service.cc:1511] Processing CreateTablet for tablet b3af91840ca144a7b9595ccb5dfd4527 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:44.063478  7006 tablet_service.cc:1511] Processing CreateTablet for tablet d91aac6ef8734a52b667a6fd42f01635 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:44.071938  6999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9456d7a00cec43ee9987067a28b4d6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.079753  7079 tablet_service.cc:1511] Processing CreateTablet for tablet 5eb704d53a3841a4aae036013059732f (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:44.067194  7081 tablet_service.cc:1511] Processing CreateTablet for tablet a1a3ee09e96b456ebb64bb214205c697 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:44.068063  7072 tablet_service.cc:1511] Processing CreateTablet for tablet 2872784458984476909e30886ad094d8 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:44.064764  7147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d6818d6b1045378a6b8ace92ed2d7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.081245  7079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eb704d53a3841a4aae036013059732f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.081993  7072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2872784458984476909e30886ad094d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.045348  7077 tablet_service.cc:1511] Processing CreateTablet for tablet 0308ffb97aa94594bc22307383a7869b (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:44.085786  7077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0308ffb97aa94594bc22307383a7869b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.095805  6997 tablet_service.cc:1511] Processing CreateTablet for tablet 2872784458984476909e30886ad094d8 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:44.107400  7005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3af91840ca144a7b9595ccb5dfd4527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.108254  7285 tablet_bootstrap.cc:492] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:44.108690  7223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc12a1d7cc98405390715e3d66ca06f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.105553  7150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 695b83e20b7a40e29be9f4c9b00baaaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.112973  7224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f8dcbe1b0441da8488ac2bd01c93fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.116734  7081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a3ee09e96b456ebb64bb214205c697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.117859  7154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3af91840ca144a7b9595ccb5dfd4527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.120878  7221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6cce034dc624ce997cbf455d69ec9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.120878  7146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a9b67ee02db405787e857725c431127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.124931  7226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5441bfff9f464980afe37a60473c5165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.112890  7006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d91aac6ef8734a52b667a6fd42f01635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.130864  7229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b568a9d33646ddab98b1429efa026e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.131129  6997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2872784458984476909e30886ad094d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.131808  7222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 807e3a465242486abefc80481a598bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.132887  7220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc5926243c0439fb58fe23dcbd604a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.133446  7003 tablet_service.cc:1511] Processing CreateTablet for tablet 7a9b67ee02db405787e857725c431127 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:44.133551  7152 tablet_service.cc:1511] Processing CreateTablet for tablet 0308ffb97aa94594bc22307383a7869b (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:44.134809  7003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a9b67ee02db405787e857725c431127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.131909  7148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d91aac6ef8734a52b667a6fd42f01635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.135984  7001 tablet_service.cc:1511] Processing CreateTablet for tablet a1a3ee09e96b456ebb64bb214205c697 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:44.136925  7227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbef1c76ff7d498c80d88abdea210535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.137531  7001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a3ee09e96b456ebb64bb214205c697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.140254  7080 tablet_service.cc:1511] Processing CreateTablet for tablet bfc2cfad86bb45cea81a8a9b6df167d8 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:44.141671  7080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfc2cfad86bb45cea81a8a9b6df167d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.157260  7155 tablet_service.cc:1511] Processing CreateTablet for tablet a1a3ee09e96b456ebb64bb214205c697 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:44.162346  7228 tablet_service.cc:1511] Processing CreateTablet for tablet dd176d00420245edb709bcf50d2ce27b (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:44.163599  7285 tablet_bootstrap.cc:654] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.165112  7288 tablet_bootstrap.cc:492] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:44.167299  7075 tablet_service.cc:1511] Processing CreateTablet for tablet 962a5b01fc1b4f9981e72dfd1f233aad (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:44.167951  7074 tablet_service.cc:1511] Processing CreateTablet for tablet a537e9b5978b4b839c72ee655456c21f (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:44.172787  7075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 962a5b01fc1b4f9981e72dfd1f233aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.175191  7287 tablet_bootstrap.cc:492] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:44.182008  7284 tablet_bootstrap.cc:492] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:44.182623  7284 ts_tablet_manager.cc:1403] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.278s	user 0.006s	sys 0.010s
I20260709 12:26:44.184373  7041 heartbeater.cc:499] Master 127.3.200.126:32897 was elected leader, sending a full tablet report...
I20260709 12:26:44.184625  7074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a537e9b5978b4b839c72ee655456c21f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.185878  7284 raft_consensus.cc:359] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:44.186654  7284 raft_consensus.cc:385] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.186939  7284 raft_consensus.cc:740] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.200691  7152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0308ffb97aa94594bc22307383a7869b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.201786  7153 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1d204ca67b42f5812cea10c0ef8911 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:44.202418  7149 tablet_service.cc:1511] Processing CreateTablet for tablet bfc2cfad86bb45cea81a8a9b6df167d8 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:44.203547  7153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1d204ca67b42f5812cea10c0ef8911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.204250  7287 tablet_bootstrap.cc:654] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.205940  7151 tablet_service.cc:1511] Processing CreateTablet for tablet 962a5b01fc1b4f9981e72dfd1f233aad (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:44.206503  7155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a3ee09e96b456ebb64bb214205c697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.207264  7151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 962a5b01fc1b4f9981e72dfd1f233aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.208609  6997 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1d204ca67b42f5812cea10c0ef8911 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:44.209973  6997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1d204ca67b42f5812cea10c0ef8911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.208642  6998 tablet_service.cc:1511] Processing CreateTablet for tablet 5eb704d53a3841a4aae036013059732f (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:44.168874  7228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd176d00420245edb709bcf50d2ce27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.218838  7149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfc2cfad86bb45cea81a8a9b6df167d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.217319  6998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eb704d53a3841a4aae036013059732f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.225647  7284 consensus_queue.cc:260] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:44.235322  7002 tablet_service.cc:1511] Processing CreateTablet for tablet 962a5b01fc1b4f9981e72dfd1f233aad (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:44.240217  7288 tablet_bootstrap.cc:654] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.244309  7154 tablet_service.cc:1511] Processing CreateTablet for tablet f91790bef199456db685133d1c9f6fc2 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:44.247822  7000 tablet_service.cc:1511] Processing CreateTablet for tablet a537e9b5978b4b839c72ee655456c21f (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:44.255805  7004 tablet_service.cc:1511] Processing CreateTablet for tablet f91790bef199456db685133d1c9f6fc2 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:44.259913  7078 tablet_service.cc:1511] Processing CreateTablet for tablet f99919774f3a4dda86c7c90ad327b9bd (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:44.271725  7002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 962a5b01fc1b4f9981e72dfd1f233aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.275120  7116 heartbeater.cc:499] Master 127.3.200.126:32897 was elected leader, sending a full tablet report...
I20260709 12:26:44.259912  7005 tablet_service.cc:1511] Processing CreateTablet for tablet 2918b8da0cae441dae40ec77664c668c (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:44.315691  7078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99919774f3a4dda86c7c90ad327b9bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.321668  7150 tablet_service.cc:1511] Processing CreateTablet for tablet 2918b8da0cae441dae40ec77664c668c (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:44.323248  7224 tablet_service.cc:1511] Processing CreateTablet for tablet 9456d7a00cec43ee9987067a28b4d6b8 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:44.324647  7224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9456d7a00cec43ee9987067a28b4d6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.326763  7006 tablet_service.cc:1511] Processing CreateTablet for tablet 3bdfdba2bae34156b0b852a03e5aa56f (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:44.334458  7146 tablet_service.cc:1511] Processing CreateTablet for tablet f99919774f3a4dda86c7c90ad327b9bd (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:44.337356  7287 tablet_bootstrap.cc:492] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:44.345932  7072 tablet_service.cc:1511] Processing CreateTablet for tablet f445b9b3112b4c7d9c76e2f7cff0e129 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:44.353238  7287 ts_tablet_manager.cc:1403] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.189s	user 0.012s	sys 0.004s
I20260709 12:26:44.353756  7072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f445b9b3112b4c7d9c76e2f7cff0e129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.370716  7080 tablet_service.cc:1511] Processing CreateTablet for tablet 2a631201d3d0438faa6efb30d0100608 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:44.372304  7080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a631201d3d0438faa6efb30d0100608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.355758  7077 tablet_service.cc:1511] Processing CreateTablet for tablet 4db7053663484d018b4dcf9bfd77b330 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:44.348001  7148 tablet_service.cc:1511] Processing CreateTablet for tablet 1f0c1fabae4b45f5a06cac8289e281ab (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:44.333256  7004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f91790bef199456db685133d1c9f6fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.406716  7000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a537e9b5978b4b839c72ee655456c21f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.349261  7284 ts_tablet_manager.cc:1434] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.166s	user 0.013s	sys 0.014s
I20260709 12:26:44.407979  7284 tablet_bootstrap.cc:492] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:44.372664  7225 tablet_service.cc:1511] Processing CreateTablet for tablet 647e97c99a2a4c41a8f6e6570074411f (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:44.411639  7225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 647e97c99a2a4c41a8f6e6570074411f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.373812  7190 heartbeater.cc:499] Master 127.3.200.126:32897 was elected leader, sending a full tablet report...
I20260709 12:26:44.413231  7005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2918b8da0cae441dae40ec77664c668c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.414630  7223 tablet_service.cc:1511] Processing CreateTablet for tablet 0308ffb97aa94594bc22307383a7869b (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:44.376690  7081 tablet_service.cc:1511] Processing CreateTablet for tablet c9573f07e2a9429cbf22a7bdc0413cb9 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:44.368109  7287 raft_consensus.cc:359] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:44.418805  7287 raft_consensus.cc:385] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.419160  7287 raft_consensus.cc:740] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.387097  7079 tablet_service.cc:1511] Processing CreateTablet for tablet 9cf21da8f96541e2b54dfd98b7f33342 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:44.392001  7072 tablet_service.cc:1511] Processing CreateTablet for tablet 854ce637450c47bd8bc6a0a482a2f0c9 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:44.395615  7285 tablet_bootstrap.cc:492] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:44.429734  7285 ts_tablet_manager.cc:1403] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.322s	user 0.027s	sys 0.016s
I20260709 12:26:44.328372  7073 tablet_service.cc:1511] Processing CreateTablet for tablet 3bdfdba2bae34156b0b852a03e5aa56f (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:44.401297  7226 tablet_service.cc:1511] Processing CreateTablet for tablet 695b83e20b7a40e29be9f4c9b00baaaa (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:44.402900  7153 tablet_service.cc:1511] Processing CreateTablet for tablet 4db7053663484d018b4dcf9bfd77b330 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:44.405506  7222 tablet_service.cc:1511] Processing CreateTablet for tablet 2872784458984476909e30886ad094d8 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:44.419912  7287 consensus_queue.cc:260] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:44.424062  7076 tablet_service.cc:1511] Processing CreateTablet for tablet 2918b8da0cae441dae40ec77664c668c (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:44.425014  7081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9573f07e2a9429cbf22a7bdc0413cb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.428908  7006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bdfdba2bae34156b0b852a03e5aa56f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.446061  7075 tablet_service.cc:1511] Processing CreateTablet for tablet 6eb05e220cae466b9a2ef8f7d1565609 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:44.447937  7221 tablet_service.cc:1511] Processing CreateTablet for tablet b3af91840ca144a7b9595ccb5dfd4527 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:44.314739  7154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f91790bef199456db685133d1c9f6fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.449640  7227 tablet_service.cc:1511] Processing CreateTablet for tablet 5eb704d53a3841a4aae036013059732f (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:44.412488  7220 tablet_service.cc:1511] Processing CreateTablet for tablet 7a9b67ee02db405787e857725c431127 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:44.452896  7148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f0c1fabae4b45f5a06cac8289e281ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.453982  7152 tablet_service.cc:1511] Processing CreateTablet for tablet f445b9b3112b4c7d9c76e2f7cff0e129 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:44.455646  7152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f445b9b3112b4c7d9c76e2f7cff0e129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.461053  7077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db7053663484d018b4dcf9bfd77b330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.461174  7153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db7053663484d018b4dcf9bfd77b330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.468465  7079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf21da8f96541e2b54dfd98b7f33342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.469235  7072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854ce637450c47bd8bc6a0a482a2f0c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.472236  7075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb05e220cae466b9a2ef8f7d1565609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.474200  7264 heartbeater.cc:499] Master 127.3.200.126:32897 was elected leader, sending a full tablet report...
I20260709 12:26:44.428357  7229 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1d204ca67b42f5812cea10c0ef8911 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:44.481153  7285 raft_consensus.cc:359] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:44.481952  7285 raft_consensus.cc:385] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.482277  7285 raft_consensus.cc:740] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.483062  7285 consensus_queue.cc:260] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:44.485816  7147 tablet_service.cc:1511] Processing CreateTablet for tablet e55a320911224afdbff15fd96f57c211 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:44.487635  7076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2918b8da0cae441dae40ec77664c668c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.487345  7074 tablet_service.cc:1511] Processing CreateTablet for tablet 6874db0bed9045fcbd3a6bd63563221c (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:44.488770  7074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6874db0bed9045fcbd3a6bd63563221c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.491446  7003 tablet_service.cc:1511] Processing CreateTablet for tablet 1f0c1fabae4b45f5a06cac8289e281ab (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:44.494483  7001 tablet_service.cc:1511] Processing CreateTablet for tablet 4db7053663484d018b4dcf9bfd77b330 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:44.499542  7284 tablet_bootstrap.cc:654] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.500732  7150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2918b8da0cae441dae40ec77664c668c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:44.501161  7117 tablet.cc:2406] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:26:44.522915  7003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f0c1fabae4b45f5a06cac8289e281ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.525197  7287 ts_tablet_manager.cc:1434] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.160s	user 0.009s	sys 0.004s
I20260709 12:26:44.529738  7001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db7053663484d018b4dcf9bfd77b330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.530108  7287 tablet_bootstrap.cc:492] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:44.503366  6997 tablet_service.cc:1511] Processing CreateTablet for tablet 9cf21da8f96541e2b54dfd98b7f33342 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:44.533485  6997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf21da8f96541e2b54dfd98b7f33342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.503389  7228 tablet_service.cc:1511] Processing CreateTablet for tablet bfc2cfad86bb45cea81a8a9b6df167d8 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:44.541777  7155 tablet_service.cc:1511] Processing CreateTablet for tablet 2a631201d3d0438faa6efb30d0100608 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:44.543097  7224 tablet_service.cc:1511] Processing CreateTablet for tablet a537e9b5978b4b839c72ee655456c21f (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:44.543725  7155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a631201d3d0438faa6efb30d0100608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.510030  7078 tablet_service.cc:1511] Processing CreateTablet for tablet 3552ed8cab2344ef9bd713ff368c26da (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:44.466189  7223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0308ffb97aa94594bc22307383a7869b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.512342  6999 tablet_service.cc:1511] Processing CreateTablet for tablet e55a320911224afdbff15fd96f57c211 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:44.552654  6999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55a320911224afdbff15fd96f57c211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.555473  7229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1d204ca67b42f5812cea10c0ef8911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.556704  7073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bdfdba2bae34156b0b852a03e5aa56f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.557889  7285 ts_tablet_manager.cc:1434] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.128s	user 0.010s	sys 0.002s
I20260709 12:26:44.558964  7285 tablet_bootstrap.cc:492] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:44.560963  7078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3552ed8cab2344ef9bd713ff368c26da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.561389  7288 tablet_bootstrap.cc:492] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:44.561950  7288 ts_tablet_manager.cc:1403] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.397s	user 0.013s	sys 0.046s
I20260709 12:26:44.564870  7228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfc2cfad86bb45cea81a8a9b6df167d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.546607  7151 tablet_service.cc:1511] Processing CreateTablet for tablet c9573f07e2a9429cbf22a7bdc0413cb9 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:44.549552  7287 tablet_bootstrap.cc:654] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.568568  7149 tablet_service.cc:1511] Processing CreateTablet for tablet 0fafe7c9150d454fbf16d21df3231a53 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:44.574301  7288 raft_consensus.cc:359] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:44.575068  7288 raft_consensus.cc:385] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.575376  7288 raft_consensus.cc:740] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.569562  7147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55a320911224afdbff15fd96f57c211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.576732  7290 raft_consensus.cc:493] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.577251  7290 raft_consensus.cc:515] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:44.582571  7225 tablet_service.cc:1511] Processing CreateTablet for tablet f91790bef199456db685133d1c9f6fc2 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:44.594466  7226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 695b83e20b7a40e29be9f4c9b00baaaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.610921  7284 tablet_bootstrap.cc:492] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:44.610647  7150 tablet_service.cc:1511] Processing CreateTablet for tablet 6eb05e220cae466b9a2ef8f7d1565609 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:44.611531  7284 ts_tablet_manager.cc:1403] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.204s	user 0.014s	sys 0.002s
I20260709 12:26:44.618007  7002 tablet_service.cc:1511] Processing CreateTablet for tablet c9573f07e2a9429cbf22a7bdc0413cb9 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:44.618844  7293 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.619838  7002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9573f07e2a9429cbf22a7bdc0413cb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.619550  7293 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:44.590638  7290 leader_election.cc:290] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:44.608469  7146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99919774f3a4dda86c7c90ad327b9bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.629395  7284 raft_consensus.cc:359] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:44.630169  7284 raft_consensus.cc:385] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.630505  7284 raft_consensus.cc:740] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.631203  7284 consensus_queue.cc:260] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:44.667995  7222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2872784458984476909e30886ad094d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.668488  7150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb05e220cae466b9a2ef8f7d1565609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.594041  7288 consensus_queue.cc:260] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:44.689630  7221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3af91840ca144a7b9595ccb5dfd4527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.700356  7151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9573f07e2a9429cbf22a7bdc0413cb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.705591  6998 tablet_service.cc:1511] Processing CreateTablet for tablet 854ce637450c47bd8bc6a0a482a2f0c9 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:44.706964  6998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854ce637450c47bd8bc6a0a482a2f0c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.713032  7223 tablet_service.cc:1511] Processing CreateTablet for tablet f99919774f3a4dda86c7c90ad327b9bd (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:44.713660  7227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eb704d53a3841a4aae036013059732f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.714437  7223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f99919774f3a4dda86c7c90ad327b9bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.726835  7287 tablet_bootstrap.cc:492] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:44.727481  7287 ts_tablet_manager.cc:1403] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.198s	user 0.034s	sys 0.024s
I20260709 12:26:44.728422  7288 ts_tablet_manager.cc:1434] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.166s	user 0.001s	sys 0.009s
I20260709 12:26:44.729564  7288 tablet_bootstrap.cc:492] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:44.711865  7000 tablet_service.cc:1511] Processing CreateTablet for tablet 0fafe7c9150d454fbf16d21df3231a53 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:44.731482  7000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fafe7c9150d454fbf16d21df3231a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.734373  7081 tablet_service.cc:1511] Processing CreateTablet for tablet e4be0c7ab6814c10832dad40146ef05c (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:44.735812  7081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4be0c7ab6814c10832dad40146ef05c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.754426  7285 tablet_bootstrap.cc:654] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.759505  7154 tablet_service.cc:1511] Processing CreateTablet for tablet 6874db0bed9045fcbd3a6bd63563221c (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:44.745376  7149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fafe7c9150d454fbf16d21df3231a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.763192  7229 tablet_service.cc:1511] Processing CreateTablet for tablet 3bdfdba2bae34156b0b852a03e5aa56f (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:44.772655  7220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a9b67ee02db405787e857725c431127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.721979  7293 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:44.777483  7072 tablet_service.cc:1511] Processing CreateTablet for tablet 0162f8268f134c95b5e6489ec3509b63 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:44.780900  7300 raft_consensus.cc:493] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.804941  7300 raft_consensus.cc:515] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:44.805642  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:44.775743  7148 tablet_service.cc:1511] Processing CreateTablet for tablet e76cdd025d4d4a159fa072347ced7f54 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:44.785370  7302 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.798602  7003 tablet_service.cc:1511] Processing CreateTablet for tablet 6874db0bed9045fcbd3a6bd63563221c (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:44.800310  7005 tablet_service.cc:1511] Processing CreateTablet for tablet e76cdd025d4d4a159fa072347ced7f54 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:44.802790  7006 tablet_service.cc:1511] Processing CreateTablet for tablet 0162f8268f134c95b5e6489ec3509b63 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:44.798602  7001 tablet_service.cc:1511] Processing CreateTablet for tablet 3552ed8cab2344ef9bd713ff368c26da (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:44.808142  7300 leader_election.cc:290] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:44.829435  7005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76cdd025d4d4a159fa072347ced7f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.829694  7146 tablet_service.cc:1511] Processing CreateTablet for tablet e4be0c7ab6814c10832dad40146ef05c (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:44.804942  7076 tablet_service.cc:1511] Processing CreateTablet for tablet c9220bb0b7044778bd5662989d6f5f2e (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:44.837500  7225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f91790bef199456db685133d1c9f6fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.838716  7154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6874db0bed9045fcbd3a6bd63563221c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:44.845845  6901 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 55137.2us
I20260709 12:26:44.872825  7288 tablet_bootstrap.cc:654] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.844774  7080 tablet_service.cc:1511] Processing CreateTablet for tablet aff8d600c9224a3089ef3ccecd0c25fd (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:44.852447  7003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6874db0bed9045fcbd3a6bd63563221c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.879750  7150 tablet_service.cc:1511] Processing CreateTablet for tablet 0162f8268f134c95b5e6489ec3509b63 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:44.827322  7302 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:44.881862  7155 tablet_service.cc:1511] Processing CreateTablet for tablet 45f7bc068fdd4b51a0c353ae62350525 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:44.882858  7302 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:26:44.844409  7054 leader_election.cc:343] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:44.887140  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 59930.4us
I20260709 12:26:44.888900  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:44.894598  7072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0162f8268f134c95b5e6489ec3509b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.844978  7287 raft_consensus.cc:359] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:44.905905  7001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3552ed8cab2344ef9bd713ff368c26da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.850785  7073 tablet_service.cc:1511] Processing CreateTablet for tablet f0b3a1db65cd47d59e35e46159033163 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:44.851522  7074 tablet_service.cc:1511] Processing CreateTablet for tablet 409650d511434499a9f653d298a44c6b (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:44.916855  7004 tablet_service.cc:1511] Processing CreateTablet for tablet 45f7bc068fdd4b51a0c353ae62350525 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:44.918226  7153 tablet_service.cc:1511] Processing CreateTablet for tablet aff8d600c9224a3089ef3ccecd0c25fd (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:44.918687  7080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff8d600c9224a3089ef3ccecd0c25fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.945676  7002 tablet_service.cc:1511] Processing CreateTablet for tablet f0b3a1db65cd47d59e35e46159033163 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:44.947077  7074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 409650d511434499a9f653d298a44c6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.952919  7073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b3a1db65cd47d59e35e46159033163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.952333  7006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0162f8268f134c95b5e6489ec3509b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.905722  7287 raft_consensus.cc:385] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.957624  7287 raft_consensus.cc:740] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.958456  7287 consensus_queue.cc:260] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:44.908849  7224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a537e9b5978b4b839c72ee655456c21f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.910485  7146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4be0c7ab6814c10832dad40146ef05c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.925634  7079 tablet_service.cc:1511] Processing CreateTablet for tablet 19b37dd1e304422ea7de68f81a21c0de (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:44.965356  7079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b37dd1e304422ea7de68f81a21c0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.929528  7152 tablet_service.cc:1511] Processing CreateTablet for tablet f0b3a1db65cd47d59e35e46159033163 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:44.969362  7152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b3a1db65cd47d59e35e46159033163. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:44.973441  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:44.917008  7000 tablet_service.cc:1511] Processing CreateTablet for tablet c9220bb0b7044778bd5662989d6f5f2e (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:44.976413  7287 ts_tablet_manager.cc:1434] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.249s	user 0.013s	sys 0.002s
I20260709 12:26:44.977622  7287 tablet_bootstrap.cc:492] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:44.980091  7155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45f7bc068fdd4b51a0c353ae62350525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.983193  7222 tablet_service.cc:1511] Processing CreateTablet for tablet 9cf21da8f96541e2b54dfd98b7f33342 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:44.935942  7151 tablet_service.cc:1511] Processing CreateTablet for tablet 85bc42d22a1b4b3c9251c1ffceeb9a22 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:44.984509  7153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff8d600c9224a3089ef3ccecd0c25fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.984800  7284 ts_tablet_manager.cc:1434] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.373s	user 0.009s	sys 0.014s
I20260709 12:26:44.985536  7151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85bc42d22a1b4b3c9251c1ffceeb9a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:44.938190  6999 tablet_service.cc:1511] Processing CreateTablet for tablet 19b37dd1e304422ea7de68f81a21c0de (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:44.932173  6997 tablet_service.cc:1511] Processing CreateTablet for tablet 409650d511434499a9f653d298a44c6b (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:44.941196  7147 tablet_service.cc:1511] Processing CreateTablet for tablet dcce83ec14dc49a18368b15fa1535d92 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:44.920083  7075 tablet_service.cc:1511] Processing CreateTablet for tablet dcce83ec14dc49a18368b15fa1535d92 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:44.933782  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:44.984278  7076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9220bb0b7044778bd5662989d6f5f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.033452  7005 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34196 (request call id 35) took 1089 ms. Trace:
I20260709 12:26:45.033950  7005 rpcz_store.cc:276] 0709 12:26:43.943771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.799421 (+855650us) service_pool.cc:224] Handling call
0709 12:26:44.828853 (+ 29432us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.828956 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:44.978833 (+149877us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.032878 (+ 54045us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.033389 (+   511us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:44.923794  7221 tablet_service.cc:1511] Processing CreateTablet for tablet 1f0c1fabae4b45f5a06cac8289e281ab (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:45.037499  7075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcce83ec14dc49a18368b15fa1535d92. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:45.038395  6980 leader_election.cc:343] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.039209  7149 tablet_service.cc:1511] Processing CreateTablet for tablet 19b37dd1e304422ea7de68f81a21c0de (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 12:26:44.901667  7054 leader_election.cc:343] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:45.040871  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 142428us
I20260709 12:26:44.985848  7284 tablet_bootstrap.cc:492] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:45.004769  7229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bdfdba2bae34156b0b852a03e5aa56f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.005033  7078 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46226 (request call id 34) took 1069 ms. Trace:
I20260709 12:26:45.014810  7148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76cdd025d4d4a159fa072347ced7f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.043016  7078 rpcz_store.cc:276] 0709 12:26:43.935833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.509058 (+573225us) service_pool.cc:224] Handling call
0709 12:26:44.548229 (+ 39171us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.550388 (+  2159us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:44.706565 (+156177us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:44.906443 (+199878us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.004968 (+ 98525us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.049252  7227 tablet_service.cc:1511] Processing CreateTablet for tablet e55a320911224afdbff15fd96f57c211 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:45.050756  7004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45f7bc068fdd4b51a0c353ae62350525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.051411  7000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9220bb0b7044778bd5662989d6f5f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.055063  6997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 409650d511434499a9f653d298a44c6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.056903  6999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b37dd1e304422ea7de68f81a21c0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.048211  7078 tablet_service.cc:1511] Processing CreateTablet for tablet fa553cbc13e74e2b9dc7574c6008bd9f (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:45.060009  7078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa553cbc13e74e2b9dc7574c6008bd9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.066636  7077 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46226 (request call id 27) took 1178 ms. Trace:
I20260709 12:26:45.067723  7002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b3a1db65cd47d59e35e46159033163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.069674  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:45.070364  7016 raft_consensus.cc:2468] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:45.073997  7150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0162f8268f134c95b5e6489ec3509b63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.067083  7077 rpcz_store.cc:276] 0709 12:26:43.888514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.354848 (+466334us) service_pool.cc:224] Handling call
0709 12:26:44.407013 (+ 52165us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.407110 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:44.747825 (+340715us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.063152 (+315327us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.066577 (+  3425us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17849}
I20260709 12:26:45.086849  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:45.087838  7202 leader_election.cc:304] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:26:45.088749  7203 leader_election.cc:343] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.089067  7304 raft_consensus.cc:2804] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.089495  7304 raft_consensus.cc:493] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.089834  7304 raft_consensus.cc:3060] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:45.092857  6899 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 56726.4us
W20260709 12:26:45.092892  6901 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 43985.9us
I20260709 12:26:45.095765  7288 tablet_bootstrap.cc:492] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:45.096212  7149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b37dd1e304422ea7de68f81a21c0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.096303  7288 ts_tablet_manager.cc:1403] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.367s	user 0.018s	sys 0.000s
I20260709 12:26:45.082742  7222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf21da8f96541e2b54dfd98b7f33342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.067296  7223 tablet_service.cc:1511] Processing CreateTablet for tablet 854ce637450c47bd8bc6a0a482a2f0c9 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:45.109911  7147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcce83ec14dc49a18368b15fa1535d92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.116015  7220 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 16) took 1087 ms. Trace:
I20260709 12:26:45.115350  7288 raft_consensus.cc:359] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:45.120816  7288 raft_consensus.cc:385] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.121245  7288 raft_consensus.cc:740] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.123373  7287 tablet_bootstrap.cc:654] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.136806  7005 tablet_service.cc:1511] Processing CreateTablet for tablet 85bc42d22a1b4b3c9251c1ffceeb9a22 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:45.138705  7154 tablet_service.cc:1511] Processing CreateTablet for tablet 459d2d4cd4d0458fba1105fdc8dd504a (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:45.140339  7154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459d2d4cd4d0458fba1105fdc8dd504a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.101591  7284 tablet_bootstrap.cc:654] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.986106  7228 tablet_service.cc:1511] Processing CreateTablet for tablet f445b9b3112b4c7d9c76e2f7cff0e129 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:45.150441  7304 raft_consensus.cc:515] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:45.151290  7224 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 21) took 1085 ms. Trace:
W20260709 12:26:45.153295  6899 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 59256.6us
W20260709 12:26:45.153857  6901 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 60057.1us
I20260709 12:26:45.116439  7220 rpcz_store.cc:276] 0709 12:26:44.028297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.410508 (+382211us) service_pool.cc:224] Handling call
0709 12:26:44.463052 (+ 52544us) spinlock_profiling.cc:243] Waited 9.75 ms on lock 0x7b5800010298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d248831 00007f287d225ac3 00007f287d1d4400 00007f2876659af4 00007f2876659a82 00007f28766599b1
0709 12:26:44.463201 (+   149us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.463298 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:44.923205 (+459907us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.115474 (+192269us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.115940 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22414592}
I20260709 12:26:45.155745  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:45.159905  7081 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46226 (request call id 35) took 1193 ms. Trace:
I20260709 12:26:45.154984  7304 leader_election.cc:290] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:45.160961  7223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854ce637450c47bd8bc6a0a482a2f0c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.122746  7288 consensus_queue.cc:260] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:45.172504  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:45.172439  7226 tablet_service.cc:1511] Processing CreateTablet for tablet 2a631201d3d0438faa6efb30d0100608 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:45.173350  7005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85bc42d22a1b4b3c9251c1ffceeb9a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.168361  7225 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 22) took 1102 ms. Trace:
I20260709 12:26:45.184857  7003 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34196 (request call id 33) took 1241 ms. Trace:
W20260709 12:26:45.185186  7203 leader_election.cc:343] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.176182  7002 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34196 (request call id 39) took 1194 ms. Trace:
I20260709 12:26:45.197558  7002 rpcz_store.cc:276] 0709 12:26:43.981246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.944714 (+963468us) service_pool.cc:224] Handling call
0709 12:26:44.946555 (+  1841us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.946653 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.114315 (+167662us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.135068 (+ 20753us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.171111 (+ 36043us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b58001b0698. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750f02b8 00007f28750f01db 00007f287e031889 00007f287d162d88 00007f287d229973 00007f287d22570f 00007f287d225ecd 00007f287d1d4400 00007f2876659af4 00007f2876659a82
0709 12:26:45.175661 (+  4550us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25568512}
I20260709 12:26:45.198709  7288 ts_tablet_manager.cc:1434] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.097s	user 0.005s	sys 0.002s
I20260709 12:26:45.198901  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:45.195981  7003 rpcz_store.cc:276] 0709 12:26:43.943200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.797658 (+854458us) service_pool.cc:224] Handling call
0709 12:26:44.838002 (+ 40344us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.852072 (+ 14070us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.005432 (+153360us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.150461 (+145029us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.184346 (+ 33885us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b58001b0698. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750f01a2 00007f287e031889 00007f287d162d88 00007f287d229973 00007f287d22570f 00007f287d225ecd 00007f287d1d4400 00007f2876659af4 00007f2876659a82
0709 12:26:45.184794 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60417408}
I20260709 12:26:45.201037  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:45.200150  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:45.196018  7016 raft_consensus.cc:3060] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.201534  7003 tablet_service.cc:1511] Processing CreateTablet for tablet 459d2d4cd4d0458fba1105fdc8dd504a (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260709 12:26:45.202687  6980 leader_election.cc:343] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.203142  6980 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:26:45.203326  7055 leader_election.cc:343] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.203809  7055 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:45.204249  7293 raft_consensus.cc:2749] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.177305  7224 rpcz_store.cc:276] 0709 12:26:44.065814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.542187 (+476373us) service_pool.cc:224] Handling call
0709 12:26:44.543959 (+  1772us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.544050 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.083687 (+539637us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.150748 (+ 67061us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.151221 (+   473us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.205554  7001 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34196 (request call id 34) took 1262 ms. Trace:
I20260709 12:26:45.205654  7302 raft_consensus.cc:2749] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.206020  7001 rpcz_store.cc:276] 0709 12:26:43.943489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.797665 (+854176us) service_pool.cc:224] Handling call
0709 12:26:44.830674 (+ 33009us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.830779 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.061857 (+231078us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.139332 (+ 77475us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.205231 (+ 65899us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b58001b0698. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750f01a2 00007f287e031889 00007f287d162d88 00007f287d229973 00007f287d22570f 00007f287d225ecd 00007f287d1d4400 00007f2876659af4 00007f2876659a82
0709 12:26:45.205494 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85734656}
I20260709 12:26:45.207850  7224 tablet_service.cc:1511] Processing CreateTablet for tablet 6eb05e220cae466b9a2ef8f7d1565609 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:45.193496  7225 rpcz_store.cc:276] 0709 12:26:44.066118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.570422 (+504304us) service_pool.cc:224] Handling call
0709 12:26:44.583647 (+ 13225us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.583773 (+   126us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.018205 (+434432us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.167754 (+149549us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.168290 (+   536us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.223124  7079 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46226 (request call id 42) took 1254 ms. Trace:
I20260709 12:26:45.223560  7079 rpcz_store.cc:276] 0709 12:26:43.969067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.924775 (+955708us) service_pool.cc:224] Handling call
0709 12:26:44.964857 (+ 40082us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.964963 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.125808 (+160845us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.222595 (+ 96787us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.223056 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.199981  7002 tablet_service.cc:1511] Processing CreateTablet for tablet fa553cbc13e74e2b9dc7574c6008bd9f (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:45.224089  7225 tablet_service.cc:1511] Processing CreateTablet for tablet 3552ed8cab2344ef9bd713ff368c26da (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:45.227576  6997 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34196 (request call id 40) took 1246 ms. Trace:
I20260709 12:26:45.228010  6997 rpcz_store.cc:276] 0709 12:26:43.981581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.930912 (+949331us) service_pool.cc:224] Handling call
0709 12:26:45.009016 (+ 78104us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.009170 (+   154us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.129016 (+119846us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.227081 (+ 98065us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.227518 (+   437us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.229981  7153 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56774 (request call id 38) took 1098 ms. Trace:
I20260709 12:26:45.230418  7153 rpcz_store.cc:276] 0709 12:26:44.131318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.917255 (+785937us) service_pool.cc:224] Handling call
0709 12:26:44.945005 (+ 27750us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.945134 (+   129us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.079913 (+134779us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.229443 (+149530us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.229924 (+   481us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.231345  7151 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56774 (request call id 40) took 1019 ms. Trace:
I20260709 12:26:45.231784  7151 rpcz_store.cc:276] 0709 12:26:44.212329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.934352 (+722023us) service_pool.cc:224] Handling call
0709 12:26:44.984896 (+ 50544us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.985041 (+   145us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.169649 (+184608us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.230794 (+ 61145us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.231291 (+   497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.209789  7226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a631201d3d0438faa6efb30d0100608. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:45.215195  7055 leader_election.cc:343] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.217546  7075 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46226 (request call id 41) took 1248 ms. Trace:
I20260709 12:26:45.232764  7285 tablet_bootstrap.cc:492] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:45.222295  7288 tablet_bootstrap.cc:492] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:45.233035  7055 leader_election.cc:304] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:45.233480  7285 ts_tablet_manager.cc:1403] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.675s	user 0.012s	sys 0.020s
I20260709 12:26:45.234042  7302 raft_consensus.cc:2749] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.233172  7075 rpcz_store.cc:276] 0709 12:26:43.968779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.918853 (+950074us) service_pool.cc:224] Handling call
0709 12:26:45.032914 (+114061us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.033011 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.158217 (+125206us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.217003 (+ 58786us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.217479 (+   476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.222398  7072 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46226 (request call id 36) took 1255 ms. Trace:
I20260709 12:26:45.235814  7072 rpcz_store.cc:276] 0709 12:26:43.967282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.776431 (+809149us) service_pool.cc:224] Handling call
0709 12:26:44.831450 (+ 55019us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.838635 (+  7185us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.045705 (+207070us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.221874 (+176169us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.222336 (+   462us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.239043  7285 raft_consensus.cc:359] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:45.240190  7285 raft_consensus.cc:385] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.240633  7285 raft_consensus.cc:740] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.245416  7285 consensus_queue.cc:260] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:45.243487  7220 tablet_service.cc:1511] Processing CreateTablet for tablet 0fafe7c9150d454fbf16d21df3231a53 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:45.248862  7000 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34196 (request call id 37) took 1304 ms. Trace:
I20260709 12:26:45.251048  7147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56774 (request call id 41) took 1037 ms. Trace:
I20260709 12:26:45.253676  7146 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56774 (request call id 35) took 1195 ms. Trace:
I20260709 12:26:45.256857  7076 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46226 (request call id 37) took 1289 ms. Trace:
I20260709 12:26:45.260142  7155 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56774 (request call id 37) took 1201 ms. Trace:
I20260709 12:26:45.232744  7080 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46226 (request call id 38) took 1264 ms. Trace:
I20260709 12:26:45.261832  7226 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 29) took 1193 ms. Trace:
I20260709 12:26:45.191083  6998 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34196 (request call id 31) took 1247 ms. Trace:
I20260709 12:26:45.266147  7148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56774 (request call id 34) took 1208 ms. Trace:
I20260709 12:26:45.268934  7073 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46226 (request call id 39) took 1300 ms. Trace:
I20260709 12:26:45.185808  7081 rpcz_store.cc:276] 0709 12:26:43.966972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.733296 (+766324us) service_pool.cc:224] Handling call
0709 12:26:44.735309 (+  2013us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.735411 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.002252 (+266841us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.159396 (+157144us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.159844 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.193037  6999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34196 (request call id 42) took 1209 ms. Trace:
I20260709 12:26:45.177865  7074 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46226 (request call id 40) took 1209 ms. Trace:
I20260709 12:26:45.281057  7003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459d2d4cd4d0458fba1105fdc8dd504a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.284994  7313 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.282322  7074 rpcz_store.cc:276] 0709 12:26:43.968444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.850642 (+882198us) service_pool.cc:224] Handling call
0709 12:26:44.944061 (+ 93419us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.944146 (+    85us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.068020 (+123874us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.147716 (+ 79696us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.177134 (+ 29418us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.289456  7002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa553cbc13e74e2b9dc7574c6008bd9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.289330  7313 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:45.281270  7228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f445b9b3112b4c7d9c76e2f7cff0e129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.280539  7148 rpcz_store.cc:276] 0709 12:26:44.057580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.774799 (+717219us) service_pool.cc:224] Handling call
0709 12:26:44.831308 (+ 56509us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.837531 (+  6223us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.162621 (+325090us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.265494 (+102873us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.266057 (+   563us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.305379  7078 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46226 (request call id 43) took 1279 ms. Trace:
I20260709 12:26:45.273864  7226 rpcz_store.cc:276] 0709 12:26:44.068274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.062321 (+994047us) service_pool.cc:224] Handling call
0709 12:26:45.209160 (+146839us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.209286 (+   126us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.254693 (+ 45407us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.261317 (+  6624us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.261768 (+   451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.270063  7000 rpcz_store.cc:276] 0709 12:26:43.944398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.870565 (+926167us) service_pool.cc:224] Handling call
0709 12:26:44.975121 (+104556us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.975218 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.081477 (+106259us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.248287 (+166810us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.248798 (+   511us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.279179  6998 rpcz_store.cc:276] 0709 12:26:43.942613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.704590 (+761977us) service_pool.cc:224] Handling call
0709 12:26:44.706482 (+  1892us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.706593 (+   111us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.023952 (+317359us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.167318 (+143366us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.189676 (+ 22358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.311223  7150 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56774 (request call id 36) took 1253 ms. Trace:
I20260709 12:26:45.311448  7004 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34196 (request call id 38) took 1346 ms. Trace:
I20260709 12:26:45.312520  7006 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34196 (request call id 36) took 1368 ms. Trace:
I20260709 12:26:45.336632  7285 ts_tablet_manager.cc:1434] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.103s	user 0.029s	sys 0.018s
I20260709 12:26:45.298229  7313 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:45.334379  7150 rpcz_store.cc:276] 0709 12:26:44.058285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.878689 (+820404us) service_pool.cc:224] Handling call
0709 12:26:44.880785 (+  2096us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.880887 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.132378 (+251491us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.310681 (+178303us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.311158 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.272497  7146 rpcz_store.cc:276] 0709 12:26:44.057904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.828704 (+770800us) service_pool.cc:224] Handling call
0709 12:26:44.870887 (+ 42183us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.871036 (+   149us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.137438 (+266402us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.252983 (+115545us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.253596 (+   613us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.334328  7300 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.344458  7226 tablet_service.cc:1511] Processing CreateTablet for tablet e76cdd025d4d4a159fa072347ced7f54 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:45.337677  7078 rpcz_store.cc:276] 0709 12:26:44.025553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.047292 (+1021739us) service_pool.cc:224] Handling call
0709 12:26:45.059531 (+ 12239us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.059632 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.261493 (+201861us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.304832 (+ 43339us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.305309 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.272516  7076 rpcz_store.cc:276] 0709 12:26:43.967578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.803903 (+836325us) service_pool.cc:224] Handling call
0709 12:26:44.889938 (+ 86035us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.890047 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.135212 (+245165us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.256168 (+120956us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.256771 (+   603us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.346460  7300 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:45.349009  7300 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:45.351223  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:45.351374  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:45.352022  7015 raft_consensus.cc:2468] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
W20260709 12:26:45.352850  7203 leader_election.cc:343] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.353767  7202 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:26:45.355396  7300 raft_consensus.cc:2804] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.355993  7300 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.356442  7300 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.357569  7225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3552ed8cab2344ef9bd713ff368c26da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.358457  7227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55a320911224afdbff15fd96f57c211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.338034  7004 rpcz_store.cc:276] 0709 12:26:43.980700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.872145 (+891445us) service_pool.cc:224] Handling call
0709 12:26:44.944278 (+ 72133us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.944406 (+   128us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.185935 (+241529us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.310977 (+125042us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.311392 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.362317  7224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb05e220cae466b9a2ef8f7d1565609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.364961  7220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fafe7c9150d454fbf16d21df3231a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.365818  7226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76cdd025d4d4a159fa072347ced7f54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.366307  7288 tablet_bootstrap.cc:654] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.367717  7284 tablet_bootstrap.cc:492] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:45.372844  7016 raft_consensus.cc:2468] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:45.373425  7284 ts_tablet_manager.cc:1403] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.388s	user 0.004s	sys 0.012s
I20260709 12:26:45.374218  7202 leader_election.cc:304] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:26:45.375101  7304 raft_consensus.cc:2804] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.371728  7287 tablet_bootstrap.cc:492] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:45.372349  7285 tablet_bootstrap.cc:492] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:45.282788  6999 rpcz_store.cc:276] 0709 12:26:43.982199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.910299 (+928100us) service_pool.cc:224] Handling call
0709 12:26:44.990981 (+ 80682us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.991096 (+   115us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.112478 (+121382us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.171386 (+ 58908us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.191383 (+ 19997us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.394677  7304 raft_consensus.cc:697] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:45.395936  7304 consensus_queue.cc:237] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:45.408675  7154 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56774 (request call id 43) took 1173 ms. Trace:
I20260709 12:26:45.413087  7229 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 24) took 1346 ms. Trace:
I20260709 12:26:45.413532  7229 rpcz_store.cc:276] 0709 12:26:44.066789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.762278 (+695489us) service_pool.cc:224] Handling call
0709 12:26:44.764005 (+  1727us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.764102 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.239007 (+474905us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.400925 (+161918us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.413026 (+ 12101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.415467  7229 tablet_service.cc:1511] Processing CreateTablet for tablet e4be0c7ab6814c10832dad40146ef05c (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:45.416676  7227 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 28) took 1348 ms. Trace:
I20260709 12:26:45.417091  7227 rpcz_store.cc:276] 0709 12:26:44.067971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.048348 (+980377us) service_pool.cc:224] Handling call
0709 12:26:45.050176 (+  1828us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.050278 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.389697 (+339419us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.416171 (+ 26474us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.416613 (+   442us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.412690  7154 rpcz_store.cc:276] 0709 12:26:44.235336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.061970 (+826634us) service_pool.cc:224] Handling call
0709 12:26:45.139803 (+ 77833us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.139917 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.351647 (+211730us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.408139 (+ 56492us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.408612 (+   473us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.418329  7284 raft_consensus.cc:359] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:45.419148  7284 raft_consensus.cc:385] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.419476  7284 raft_consensus.cc:740] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.422645  7002 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34196 (request call id 43) took 1440 ms. Trace:
I20260709 12:26:45.423069  7002 rpcz_store.cc:276] 0709 12:26:43.982474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.199016 (+1216542us) service_pool.cc:224] Handling call
0709 12:26:45.225000 (+ 25984us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.225159 (+   159us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.310035 (+ 84876us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.422143 (+112108us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.422582 (+   439us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.279827  7073 rpcz_store.cc:276] 0709 12:26:43.968170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.849824 (+881654us) service_pool.cc:224] Handling call
0709 12:26:44.943456 (+ 93632us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.943561 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.031738 (+ 88177us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.268428 (+236690us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.268874 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.273320  7080 rpcz_store.cc:276] 0709 12:26:43.967885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.841759 (+873874us) service_pool.cc:224] Handling call
0709 12:26:44.890629 (+ 48870us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d248831 00007f287d225ac3 00007f287d1d4400 00007f2876659af4 00007f2876659a82 00007f28766599b1
0709 12:26:44.890802 (+   173us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.890925 (+   123us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.044386 (+153461us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.232201 (+187815us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.232681 (+   480us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26093952}
I20260709 12:26:45.426245  7221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f0c1fabae4b45f5a06cac8289e281ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.273206  7155 rpcz_store.cc:276] 0709 12:26:44.058681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.880825 (+822144us) service_pool.cc:224] Handling call
0709 12:26:44.882725 (+  1900us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.882819 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.081748 (+198929us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.259599 (+177851us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.260070 (+   471us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.427350  7229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4be0c7ab6814c10832dad40146ef05c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.431794  7223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 30) took 1363 ms. Trace:
I20260709 12:26:45.402437  7287 ts_tablet_manager.cc:1403] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.425s	user 0.013s	sys 0.049s
I20260709 12:26:45.426055  7224 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 32) took 1267 ms. Trace:
I20260709 12:26:45.432263  7223 rpcz_store.cc:276] 0709 12:26:44.097587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.066366 (+968779us) service_pool.cc:224] Handling call
0709 12:26:45.110358 (+ 43992us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.110459 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.271294 (+160835us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.421712 (+150418us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.431734 (+ 10022us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.435808  7287 raft_consensus.cc:359] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:45.372872  7313 raft_consensus.cc:493] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.271528  7147 rpcz_store.cc:276] 0709 12:26:44.213217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.940221 (+727004us) service_pool.cc:224] Handling call
0709 12:26:45.014076 (+ 73855us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.014210 (+   134us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.133901 (+119691us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.250549 (+116648us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.250990 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.438053  7287 raft_consensus.cc:385] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.446139  7287 raft_consensus.cc:740] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.447101  7287 consensus_queue.cc:260] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:45.453397  7003 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34196 (request call id 44) took 1411 ms. Trace:
I20260709 12:26:45.455256  7003 rpcz_store.cc:276] 0709 12:26:44.041846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.200517 (+1158671us) service_pool.cc:224] Handling call
0709 12:26:45.202525 (+  2008us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.202633 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.425947 (+223314us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.452794 (+ 26847us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.453319 (+   525us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.458300  7287 ts_tablet_manager.cc:1434] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.003s
I20260709 12:26:45.339311  7006 rpcz_store.cc:276] 0709 12:26:43.944069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.801926 (+857857us) service_pool.cc:224] Handling call
0709 12:26:44.830035 (+ 28109us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.830145 (+   110us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.174373 (+344228us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.312057 (+137684us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.312462 (+   405us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.458643  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:45.459758  7223 tablet_service.cc:1511] Processing CreateTablet for tablet c9220bb0b7044778bd5662989d6f5f2e (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:45.473024  7293 raft_consensus.cc:493] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.473321  7287 tablet_bootstrap.cc:492] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:45.473618  7293 raft_consensus.cc:515] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:45.479013  7293 leader_election.cc:290] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:45.420269  7284 consensus_queue.cc:260] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:45.487510  7091 raft_consensus.cc:2468] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:45.438166  7224 rpcz_store.cc:276] 0709 12:26:44.159006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.206657 (+1047651us) service_pool.cc:224] Handling call
0709 12:26:45.226827 (+ 20170us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.226948 (+   121us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.411599 (+184651us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.423594 (+ 11995us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.425901 (+  2307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.463274  7313 raft_consensus.cc:515] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:45.491065  7131 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:45.492626  7224 tablet_service.cc:1511] Processing CreateTablet for tablet aff8d600c9224a3089ef3ccecd0c25fd (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:45.494630  7313 leader_election.cc:290] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:45.495242  7313 raft_consensus.cc:2804] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.495616  7313 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.501538  7313 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.510913  7287 tablet_bootstrap.cc:654] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.497987  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:45.485806  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:45.480291  7149 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:56774 (request call id 42) took 1248 ms. Trace:
I20260709 12:26:45.497362  7284 ts_tablet_manager.cc:1434] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.124s	user 0.004s	sys 0.003s
I20260709 12:26:45.519681  7227 tablet_service.cc:1511] Processing CreateTablet for tablet 45f7bc068fdd4b51a0c353ae62350525 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 12:26:45.520082  6982 leader_election.cc:343] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.520895  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:45.521777  7149 rpcz_store.cc:276] 0709 12:26:44.231789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.038226 (+806437us) service_pool.cc:224] Handling call
0709 12:26:45.040049 (+  1823us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.040153 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.269598 (+229445us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.479762 (+210164us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.480218 (+   456us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:45.534425  6980 leader_election.cc:343] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.535405  7284 tablet_bootstrap.cc:492] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:45.540990  7016 raft_consensus.cc:2393] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 1: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:26:45.540797  6980 leader_election.cc:304] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:45.542884  7293 raft_consensus.cc:2749] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.547325  7224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff8d600c9224a3089ef3ccecd0c25fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.552989  7227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45f7bc068fdd4b51a0c353ae62350525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.555050  7222 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 27) took 1487 ms. Trace:
I20260709 12:26:45.555517  7222 rpcz_store.cc:276] 0709 12:26:44.067681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.981899 (+914218us) service_pool.cc:224] Handling call
0709 12:26:45.037425 (+ 55526us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.037524 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.449358 (+411834us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.514169 (+ 64811us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.554983 (+ 40814us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.556763  7223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9220bb0b7044778bd5662989d6f5f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.557143  7221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 25) took 1490 ms. Trace:
I20260709 12:26:45.530486  7285 tablet_bootstrap.cc:654] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.531153  7300 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:45.565505  7220 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 31) took 1414 ms. Trace:
I20260709 12:26:45.565567  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:45.565939  7229 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 35) took 1406 ms. Trace:
I20260709 12:26:45.566030  7288 tablet_bootstrap.cc:492] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:45.566407  7229 rpcz_store.cc:276] 0709 12:26:44.159926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.414515 (+1254589us) service_pool.cc:224] Handling call
0709 12:26:45.416285 (+  1770us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.416378 (+    93us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.465789 (+ 49411us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.565416 (+ 99627us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.565884 (+   468us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.572908  7288 ts_tablet_manager.cc:1403] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.351s	user 0.034s	sys 0.085s
I20260709 12:26:45.566141  7220 rpcz_store.cc:276] 0709 12:26:44.158607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.196035 (+1037428us) service_pool.cc:224] Handling call
0709 12:26:45.270763 (+ 74728us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.270860 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.502418 (+231558us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.564984 (+ 62566us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.565443 (+   459us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:45.573885  7203 leader_election.cc:343] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.574316  7229 tablet_service.cc:1511] Processing CreateTablet for tablet 409650d511434499a9f653d298a44c6b (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:45.567006  7221 rpcz_store.cc:276] 0709 12:26:44.067076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.918007 (+850931us) service_pool.cc:224] Handling call
0709 12:26:45.037632 (+119625us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.037727 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.483714 (+445987us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.556468 (+ 72754us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.557068 (+   600us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.583930  7221 tablet_service.cc:1511] Processing CreateTablet for tablet fa553cbc13e74e2b9dc7574c6008bd9f (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:45.585439  7300 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:45.585773  7220 tablet_service.cc:1511] Processing CreateTablet for tablet dcce83ec14dc49a18368b15fa1535d92 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:45.588351  7222 tablet_service.cc:1511] Processing CreateTablet for tablet 85bc42d22a1b4b3c9251c1ffceeb9a22 (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:45.591601  7229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 409650d511434499a9f653d298a44c6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.593726  7288 raft_consensus.cc:359] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:45.594691  7288 raft_consensus.cc:385] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.595038  7288 raft_consensus.cc:740] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.595944  7288 consensus_queue.cc:260] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:45.597178  7284 tablet_bootstrap.cc:654] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.598518  7288 ts_tablet_manager.cc:1434] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.002s
I20260709 12:26:45.609637  7285 tablet_bootstrap.cc:492] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:45.611699  7287 tablet_bootstrap.cc:492] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:45.616135  7225 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 33) took 1456 ms. Trace:
I20260709 12:26:45.622215  7227 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 37) took 1461 ms. Trace:
I20260709 12:26:45.617311  7228 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 26) took 1550 ms. Trace:
I20260709 12:26:45.623981  7227 rpcz_store.cc:276] 0709 12:26:44.160548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.471699 (+1311151us) service_pool.cc:224] Handling call
0709 12:26:45.548736 (+ 77037us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.548841 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.598660 (+ 49819us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.603950 (+  5290us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.622121 (+ 18171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.624907  7228 rpcz_store.cc:276] 0709 12:26:44.067400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.942774 (+875374us) service_pool.cc:224] Handling call
0709 12:26:45.149106 (+206332us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.149210 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.462368 (+313158us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.598233 (+135865us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.617251 (+ 19018us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.616916  7226 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 34) took 1457 ms. Trace:
I20260709 12:26:45.626296  7226 rpcz_store.cc:276] 0709 12:26:44.159609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.343478 (+1183869us) service_pool.cc:224] Handling call
0709 12:26:45.348633 (+  5155us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.348836 (+   203us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.469720 (+120884us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.587174 (+117454us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.616858 (+ 29684us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.627044  7227 tablet_service.cc:1511] Processing CreateTablet for tablet 459d2d4cd4d0458fba1105fdc8dd504a (DEFAULT_TABLE table=test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:45.623674  7225 rpcz_store.cc:276] 0709 12:26:44.159305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.223121 (+1063816us) service_pool.cc:224] Handling call
0709 12:26:45.225476 (+  2355us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.225564 (+    88us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.507289 (+281725us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.597284 (+ 89995us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.616070 (+ 18786us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.618521  7288 tablet_bootstrap.cc:492] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:45.612674  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:45.623624  7287 ts_tablet_manager.cc:1403] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.151s	user 0.010s	sys 0.005s
I20260709 12:26:45.617911  7222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85bc42d22a1b4b3c9251c1ffceeb9a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.632943  7287 raft_consensus.cc:359] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:45.633680  7287 raft_consensus.cc:385] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.633975  7287 raft_consensus.cc:740] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.634702  7287 consensus_queue.cc:260] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:45.635823  7221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa553cbc13e74e2b9dc7574c6008bd9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.636952  7287 ts_tablet_manager.cc:1434] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:45.610250  7285 ts_tablet_manager.cc:1403] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.238s	user 0.015s	sys 0.028s
I20260709 12:26:45.643265  7220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcce83ec14dc49a18368b15fa1535d92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.646435  7288 tablet_bootstrap.cc:654] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.646591  7287 tablet_bootstrap.cc:492] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:45.647356  7284 tablet_bootstrap.cc:492] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:45.647871  7284 ts_tablet_manager.cc:1403] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.113s	user 0.025s	sys 0.023s
I20260709 12:26:45.649025  7227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459d2d4cd4d0458fba1105fdc8dd504a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:45.650969  7284 raft_consensus.cc:359] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:45.651736  7284 raft_consensus.cc:385] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.652032  7284 raft_consensus.cc:740] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.652882  7284 consensus_queue.cc:260] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:45.654088  7285 raft_consensus.cc:359] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:45.654851  7285 raft_consensus.cc:385] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.655083  7284 ts_tablet_manager.cc:1434] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:45.655146  7285 raft_consensus.cc:740] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.656246  7284 tablet_bootstrap.cc:492] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:45.657505  7287 tablet_bootstrap.cc:654] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.663453  7284 tablet_bootstrap.cc:654] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.641949  7313 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:45.666199  7313 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:45.656037  7285 consensus_queue.cc:260] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:45.669402  7285 ts_tablet_manager.cc:1434] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:26:45.670718  7285 tablet_bootstrap.cc:492] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:45.680040  7229 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 39) took 1461 ms. Trace:
I20260709 12:26:45.789167  7229 rpcz_store.cc:276] 0709 12:26:44.226816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.573325 (+1346509us) service_pool.cc:224] Handling call
0709 12:26:45.590908 (+ 17583us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.591089 (+   181us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.655663 (+ 64574us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.679348 (+ 23685us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.679954 (+   606us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38144}
W20260709 12:26:45.722653  6899 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 152072us
I20260709 12:26:45.729240  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:45.791632  7016 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.790796  7224 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 38) took 1573 ms. Trace:
I20260709 12:26:45.792781  7224 rpcz_store.cc:276] 0709 12:26:44.218577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.491637 (+1273060us) service_pool.cc:224] Handling call
0709 12:26:45.545028 (+ 53391us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.546849 (+  1821us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.639558 (+ 92709us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.788058 (+148500us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.790505 (+  2447us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.750312  7005 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34196 (request call id 41) took 1768 ms. Trace:
I20260709 12:26:45.800798  7005 rpcz_store.cc:276] 0709 12:26:43.981904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.035733 (+1053829us) service_pool.cc:224] Handling call
0709 12:26:45.156510 (+120777us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b58001b0698. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d248831 00007f287d225ac3 00007f287d1d4400 00007f2876659af4 00007f2876659a82 00007f28766599b1
0709 12:26:45.172617 (+ 16107us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.172785 (+   168us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.493628 (+320843us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.748822 (+255194us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.750049 (+  1227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32538880}
W20260709 12:26:45.751379  7129 leader_election.cc:343] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.803617  7227 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 43) took 1541 ms. Trace:
W20260709 12:26:45.803848  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 52809.3us
I20260709 12:26:45.753036  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:45.779003  7221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 42) took 1517 ms. Trace:
I20260709 12:26:45.739609  6914 catalog_manager.cc:5697] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 1 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.805063  7091 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.799424  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:45.799369  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:26:45.809897  7129 leader_election.cc:343] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.683419  7285 tablet_bootstrap.cc:654] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.814452  7129 leader_election.cc:304] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:45.815634  7284 tablet_bootstrap.cc:492] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:45.787808  7223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 36) took 1627 ms. Trace:
I20260709 12:26:45.816605  7284 ts_tablet_manager.cc:1403] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.161s	user 0.006s	sys 0.028s
I20260709 12:26:45.817037  7223 rpcz_store.cc:276] 0709 12:26:44.160269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.458735 (+1298466us) service_pool.cc:224] Handling call
0709 12:26:45.544857 (+ 86122us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b5800010298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750eff8c 00007f28750efef6 000000000036eb39 00007f287d1631e0 00007f287d24884c 00007f287d225ac3 00007f287d1d4400 00007f2876659af4 00007f2876659a82 00007f28766599b1
0709 12:26:45.556277 (+ 11420us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.556383 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.774950 (+218567us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.787042 (+ 12092us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.787597 (+   555us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2620800}
I20260709 12:26:45.687801  7288 tablet_bootstrap.cc:492] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:45.819409  7300 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.820065  7288 ts_tablet_manager.cc:1403] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.202s	user 0.020s	sys 0.032s
I20260709 12:26:45.820287  7300 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:45.823509  7164 raft_consensus.cc:3060] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.688345  7287 tablet_bootstrap.cc:492] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:45.824236  7091 raft_consensus.cc:2468] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:45.825481  7287 ts_tablet_manager.cc:1403] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.179s	user 0.011s	sys 0.006s
I20260709 12:26:45.826468  7131 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:45.818538  7302 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.828824  7220 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 41) took 1567 ms. Trace:
I20260709 12:26:45.828827  7302 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:45.829470  7220 rpcz_store.cc:276] 0709 12:26:44.261321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.576020 (+1314699us) service_pool.cc:224] Handling call
0709 12:26:45.619551 (+ 43531us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.619663 (+   112us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.775373 (+155710us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.800315 (+ 24942us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.828666 (+ 28351us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.829891  7287 raft_consensus.cc:359] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:45.830971  7287 raft_consensus.cc:385] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.831297  7287 raft_consensus.cc:740] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.832700  7304 consensus_queue.cc:1048] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:45.833066  7288 raft_consensus.cc:359] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:45.833870  7288 raft_consensus.cc:385] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.834165  7288 raft_consensus.cc:740] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.834355  7302 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:45.835081  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:45.835148  7288 consensus_queue.cc:260] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:45.838088  7288 ts_tablet_manager.cc:1434] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:26:45.839629  7288 tablet_bootstrap.cc:492] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:45.832165  7287 consensus_queue.cc:260] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:45.841329  7313 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.841828  7313 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:45.842283  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:45.843153  7287 ts_tablet_manager.cc:1434] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:26:45.804854  7221 rpcz_store.cc:276] 0709 12:26:44.261605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.582960 (+1321355us) service_pool.cc:224] Handling call
0709 12:26:45.587509 (+  4549us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b5800010298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d248831 00007f287d225ac3 00007f287d1d4400 00007f2876659af4 00007f2876659a82 00007f28766599b1
0709 12:26:45.612437 (+ 24928us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.635442 (+ 23005us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.769774 (+134332us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.777976 (+  8202us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.778756 (+   780us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5133568}
W20260709 12:26:45.844409  7203 leader_election.cc:343] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.845968  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:45.846756  7091 raft_consensus.cc:2468] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:45.846880  7016 raft_consensus.cc:2468] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
W20260709 12:26:45.847149  7054 leader_election.cc:343] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.844306  7313 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:45.848297  7202 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:26:45.848672  7316 raft_consensus.cc:2804] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.849187  7316 raft_consensus.cc:697] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:45.848294  7131 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:45.850378  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:45.851133  7015 raft_consensus.cc:2468] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:45.850526  7316 consensus_queue.cc:237] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:45.852968  7304 raft_consensus.cc:2804] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.853638  7304 raft_consensus.cc:697] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:45.855257  7287 tablet_bootstrap.cc:492] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:45.854959  7304 consensus_queue.cc:237] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:45.856148  7300 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:45.858884  7284 raft_consensus.cc:359] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:45.862533  7284 raft_consensus.cc:385] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.863571  7320 raft_consensus.cc:2804] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.864179  7320 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.864598  7320 raft_consensus.cc:3060] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.865835  7285 tablet_bootstrap.cc:492] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:45.871392  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:26:45.873466  7055 leader_election.cc:343] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.874191  7055 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:45.875180  7302 raft_consensus.cc:2749] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.874195  7284 raft_consensus.cc:740] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.876340  7285 ts_tablet_manager.cc:1403] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.205s	user 0.016s	sys 0.000s
I20260709 12:26:45.876782  7284 consensus_queue.cc:260] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:45.880280  7222 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49148 (request call id 40) took 1616 ms. Trace:
I20260709 12:26:45.804080  7227 rpcz_store.cc:276] 0709 12:26:44.261898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.625793 (+1363895us) service_pool.cc:224] Handling call
0709 12:26:45.628199 (+  2406us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.628325 (+   126us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.780876 (+152551us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.802780 (+ 21904us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.803421 (+   641us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.884544  7287 tablet_bootstrap.cc:654] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.887701  7313 raft_consensus.cc:2749] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.889679  7304 consensus_queue.cc:1048] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.893293  7285 raft_consensus.cc:359] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:45.894098  7285 raft_consensus.cc:385] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.894493  7285 raft_consensus.cc:740] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.895184  7320 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:45.883121  7222 rpcz_store.cc:276] 0709 12:26:44.260972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.577555 (+1316583us) service_pool.cc:224] Handling call
0709 12:26:45.616285 (+ 38730us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.616402 (+   117us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.640178 (+ 23776us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.773410 (+133232us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.877183 (+103773us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.899760  7288 tablet_bootstrap.cc:654] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.899627  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:45.900939  7016 raft_consensus.cc:3060] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.906373  7293 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.907189  7293 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:45.912259  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:45.914346  6982 leader_election.cc:343] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.915658  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:45.916617  7293 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:26:45.917328  6980 leader_election.cc:343] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.903841  7320 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:45.921952  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:45.922607  7091 raft_consensus.cc:3060] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.923172  7284 ts_tablet_manager.cc:1434] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.106s	user 0.002s	sys 0.007s
I20260709 12:26:45.917909  6980 leader_election.cc:304] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:45.925664  7293 raft_consensus.cc:2749] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.927516  7284 tablet_bootstrap.cc:492] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:45.931123  7016 raft_consensus.cc:2468] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:45.920914  7285 consensus_queue.cc:260] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:45.932791  7128 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:45.933825  7320 raft_consensus.cc:2804] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.934311  7320 raft_consensus.cc:697] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:45.935370  7320 consensus_queue.cc:237] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:45.941385  7287 tablet_bootstrap.cc:492] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:45.942009  7287 ts_tablet_manager.cc:1403] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.098s	user 0.022s	sys 0.015s
I20260709 12:26:45.955166  7284 tablet_bootstrap.cc:654] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.958066  7285 ts_tablet_manager.cc:1434] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.000s
I20260709 12:26:45.959323  7288 tablet_bootstrap.cc:492] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:45.962543  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:45.965996  7288 ts_tablet_manager.cc:1403] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.127s	user 0.015s	sys 0.025s
W20260709 12:26:45.970160  7205 leader_election.cc:343] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.970403  7285 tablet_bootstrap.cc:492] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:45.971172  7091 raft_consensus.cc:2468] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
W20260709 12:26:45.983426  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:45.999017  7205 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:46.004781  7300 raft_consensus.cc:2749] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.005607  7287 raft_consensus.cc:359] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.006557  7287 raft_consensus.cc:385] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.006965  7287 raft_consensus.cc:740] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.001660  7288 raft_consensus.cc:359] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.008821  7288 raft_consensus.cc:385] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.009260  7288 raft_consensus.cc:740] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.008857  6912 catalog_manager.cc:5697] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 1 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.010332  7288 consensus_queue.cc:260] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.011040  7285 tablet_bootstrap.cc:654] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.009145  7287 consensus_queue.cc:260] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.013085  7288 ts_tablet_manager.cc:1434] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.001s
I20260709 12:26:46.014015  7287 ts_tablet_manager.cc:1434] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.004s
I20260709 12:26:46.015671  7287 tablet_bootstrap.cc:492] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:46.016041  6914 catalog_manager.cc:5697] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 1 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.018051  6914 catalog_manager.cc:5697] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 1 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.023819  7288 tablet_bootstrap.cc:492] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:46.027503  7287 tablet_bootstrap.cc:654] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.034035  7288 tablet_bootstrap.cc:654] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.037725  7287 tablet_bootstrap.cc:492] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:46.038616  7287 ts_tablet_manager.cc:1403] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.002s
I20260709 12:26:46.042245  7287 raft_consensus.cc:359] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.043148  7287 raft_consensus.cc:385] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.043552  7287 raft_consensus.cc:740] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.044641  7287 consensus_queue.cc:260] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.048517  7287 ts_tablet_manager.cc:1434] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.007s
I20260709 12:26:46.048840  7285 tablet_bootstrap.cc:492] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:46.049400  7285 ts_tablet_manager.cc:1403] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.079s	user 0.018s	sys 0.016s
I20260709 12:26:46.050204  7287 tablet_bootstrap.cc:492] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:46.054039  7285 raft_consensus.cc:359] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.054813  7285 raft_consensus.cc:385] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.055109  7285 raft_consensus.cc:740] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.057250  7285 consensus_queue.cc:260] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.060119  7287 tablet_bootstrap.cc:654] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.064675  7285 ts_tablet_manager.cc:1434] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:26:46.062637  7284 tablet_bootstrap.cc:492] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:46.067492  7285 tablet_bootstrap.cc:492] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:46.066309  7284 ts_tablet_manager.cc:1403] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.142s	user 0.028s	sys 0.000s
I20260709 12:26:46.070451  7288 tablet_bootstrap.cc:492] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:46.074681  7288 ts_tablet_manager.cc:1403] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.004s
I20260709 12:26:46.075517  7284 raft_consensus.cc:359] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.076130  7284 raft_consensus.cc:385] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.076377  7284 raft_consensus.cc:740] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.077272  7284 consensus_queue.cc:260] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.081732  7288 raft_consensus.cc:359] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:46.082902  7288 raft_consensus.cc:385] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.088200  7284 ts_tablet_manager.cc:1434] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:26:46.083328  7288 raft_consensus.cc:740] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.090021  7288 consensus_queue.cc:260] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:46.091339  7285 tablet_bootstrap.cc:654] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.092022  7287 tablet_bootstrap.cc:492] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:46.092211  7284 tablet_bootstrap.cc:492] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:46.092655  7287 ts_tablet_manager.cc:1403] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.043s	user 0.026s	sys 0.013s
I20260709 12:26:46.094213  7288 ts_tablet_manager.cc:1434] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 12:26:46.095822  7287 raft_consensus.cc:359] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:46.096644  7287 raft_consensus.cc:385] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.096937  7287 raft_consensus.cc:740] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.097635  7288 tablet_bootstrap.cc:492] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:46.097877  7287 consensus_queue.cc:260] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:46.099850  7284 tablet_bootstrap.cc:654] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.103366  7287 ts_tablet_manager.cc:1434] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:26:46.104846  7287 tablet_bootstrap.cc:492] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:46.110029  7302 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.110790  7302 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.116499  7287 tablet_bootstrap.cc:654] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.124302  7288 tablet_bootstrap.cc:654] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.126391  7302 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:46.127137  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:46.129784  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:26:46.129863  7055 leader_election.cc:343] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.130555  7239 raft_consensus.cc:2468] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 0.
I20260709 12:26:46.132282  7055 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:26:46.133279  7302 raft_consensus.cc:2804] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.133850  7302 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.135973  7285 tablet_bootstrap.cc:492] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:46.136145  7284 tablet_bootstrap.cc:492] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:46.136503  7285 ts_tablet_manager.cc:1403] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.021s
I20260709 12:26:46.136646  7284 ts_tablet_manager.cc:1403] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.013s
I20260709 12:26:46.136842  7302 raft_consensus.cc:3060] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.137138  7287 tablet_bootstrap.cc:492] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:46.137715  7300 raft_consensus.cc:493] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.138206  7300 raft_consensus.cc:515] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.141527  7300 leader_election.cc:290] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:46.141979  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:46.142817  7014 raft_consensus.cc:2468] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:46.143076  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:46.144361  7202 leader_election.cc:304] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:26:46.145308  7205 leader_election.cc:343] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.145458  7300 raft_consensus.cc:2804] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.145979  7300 raft_consensus.cc:493] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.145272  7287 ts_tablet_manager.cc:1403] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.016s
I20260709 12:26:46.146401  7300 raft_consensus.cc:3060] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.146675  7285 raft_consensus.cc:359] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.147506  7285 raft_consensus.cc:385] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.147807  7285 raft_consensus.cc:740] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.146236  7302 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.148718  7285 consensus_queue.cc:260] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.150779  7302 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:46.151510  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
W20260709 12:26:46.153290  7055 leader_election.cc:343] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.154538  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:46.155170  7239 raft_consensus.cc:3060] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.156637  7284 raft_consensus.cc:359] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.157744  7284 raft_consensus.cc:385] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.158150  7284 raft_consensus.cc:740] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.158811  7285 ts_tablet_manager.cc:1434] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.003s
I20260709 12:26:46.159523  7284 consensus_queue.cc:260] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.163389  7239 raft_consensus.cc:2468] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:26:46.164975  7055 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:26:46.167591  7285 tablet_bootstrap.cc:492] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:46.149946  7287 raft_consensus.cc:359] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:46.169090  7287 raft_consensus.cc:385] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.169488  7293 raft_consensus.cc:493] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.169835  7287 raft_consensus.cc:740] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.170305  7293 raft_consensus.cc:515] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:46.171464  7287 consensus_queue.cc:260] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:46.170639  7359 raft_consensus.cc:2804] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.174350  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:46.164479  7300 raft_consensus.cc:515] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.175559  7287 ts_tablet_manager.cc:1434] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.002s
W20260709 12:26:46.176018  6982 leader_election.cc:343] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.176797  7287 tablet_bootstrap.cc:492] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:46.177626  7300 leader_election.cc:290] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:46.178048  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:46.178803  7014 raft_consensus.cc:3060] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.175873  7288 tablet_bootstrap.cc:492] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:46.181174  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:46.197175  7287 tablet_bootstrap.cc:654] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.197340  7091 raft_consensus.cc:3060] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.198414  7284 ts_tablet_manager.cc:1434] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 12:26:46.190583  7359 raft_consensus.cc:697] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:26:46.193531  7285 tablet_bootstrap.cc:654] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.199843  7359 consensus_queue.cc:237] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.185547  7288 ts_tablet_manager.cc:1403] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.088s	user 0.008s	sys 0.030s
I20260709 12:26:46.191010  7293 leader_election.cc:290] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:46.198467  7014 raft_consensus.cc:2468] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:46.204774  7288 raft_consensus.cc:359] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.205560  7202 leader_election.cc:304] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:46.191813  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:26:46.207583  6980 leader_election.cc:343] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.207893  7285 tablet_bootstrap.cc:492] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:46.208076  6980 leader_election.cc:304] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:46.208611  7285 ts_tablet_manager.cc:1403] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.005s
I20260709 12:26:46.208724  7300 raft_consensus.cc:2804] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.209282  7287 tablet_bootstrap.cc:492] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:46.209642  7300 raft_consensus.cc:697] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:46.209905  7293 raft_consensus.cc:2749] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.209785  7287 ts_tablet_manager.cc:1403] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.015s
I20260709 12:26:46.205616  7288 raft_consensus.cc:385] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.211033  7300 consensus_queue.cc:237] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.216699  7288 raft_consensus.cc:740] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.216693  7285 raft_consensus.cc:359] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.212857  7287 raft_consensus.cc:359] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:46.217779  7285 raft_consensus.cc:385] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.218293  7285 raft_consensus.cc:740] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.218048  7288 consensus_queue.cc:260] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.217857  7287 raft_consensus.cc:385] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.219667  7285 consensus_queue.cc:260] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.220445  7287 raft_consensus.cc:740] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.208741  7284 tablet_bootstrap.cc:492] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:46.221269  6913 catalog_manager.cc:5697] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66). New cstate: current_term: 1 leader_uuid: "9e6e5c8ad44447588681b10df7ad79ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.221464  7288 ts_tablet_manager.cc:1434] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 12:26:46.224033  7288 tablet_bootstrap.cc:492] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:46.231307  7285 ts_tablet_manager.cc:1434] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:26:46.216210  7091 raft_consensus.cc:2468] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:46.221302  7287 consensus_queue.cc:260] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:46.228392  7320 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.232792  7285 tablet_bootstrap.cc:492] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:46.233067  7320 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.234382  7287 ts_tablet_manager.cc:1434] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:26:46.235302  7320 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:46.235514  7287 tablet_bootstrap.cc:492] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:46.238297  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:46.239581  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:26:46.244889  7131 leader_election.cc:343] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.240170  6913 catalog_manager.cc:5697] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 1 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.240631  7285 tablet_bootstrap.cc:654] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:46.246230  7129 leader_election.cc:343] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.246688  7129 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:46.244087  7293 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.249181  7293 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.251271  7293 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:46.252882  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:46.253795  7320 raft_consensus.cc:2749] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:46.254487  6980 leader_election.cc:343] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.255239  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:46.255853  7090 raft_consensus.cc:2468] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:26:46.256897  7288 tablet_bootstrap.cc:654] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.257234  6982 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:46.258569  7293 raft_consensus.cc:2804] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.258968  7293 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.259292  7293 raft_consensus.cc:3060] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.263306  7284 tablet_bootstrap.cc:654] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.274080  7287 tablet_bootstrap.cc:654] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.275400  7320 raft_consensus.cc:493] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.276064  7320 raft_consensus.cc:515] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:46.278939  7320 leader_election.cc:290] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:46.280230  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:46.281316  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:46.282148  7014 raft_consensus.cc:2468] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:46.283301  7128 leader_election.cc:304] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:46.283706  7091 raft_consensus.cc:2468] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:46.284190  7300 consensus_queue.cc:1048] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.284828  7304 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.285284  7304 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.285933  7293 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.287429  7304 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:46.283510  7288 tablet_bootstrap.cc:492] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:46.288240  7288 ts_tablet_manager.cc:1403] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.065s	user 0.025s	sys 0.005s
I20260709 12:26:46.289016  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:46.289664  7164 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:46.290928  7203 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:46.291133  7288 raft_consensus.cc:359] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.293627  7293 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:46.291816  7288 raft_consensus.cc:385] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.295060  7288 raft_consensus.cc:740] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.294688  7284 tablet_bootstrap.cc:492] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:46.296388  7284 ts_tablet_manager.cc:1403] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.006s
I20260709 12:26:46.297065  7288 consensus_queue.cc:260] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.297407  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:46.298703  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:46.299002  7089 raft_consensus.cc:3060] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.299355  7090 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:46.300266  7304 raft_consensus.cc:2804] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.300707  7304 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.298113  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:46.298339  7285 tablet_bootstrap.cc:492] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:46.302083  7285 ts_tablet_manager.cc:1403] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.070s	user 0.025s	sys 0.009s
W20260709 12:26:46.302784  6980 leader_election.cc:343] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.301047  7304 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.305213  7285 raft_consensus.cc:359] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:46.305961  7285 raft_consensus.cc:385] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.306273  7285 raft_consensus.cc:740] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.307029  7284 raft_consensus.cc:359] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:46.307410  7320 raft_consensus.cc:2804] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.308764  7284 raft_consensus.cc:385] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.308856  7320 raft_consensus.cc:493] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.309258  7284 raft_consensus.cc:740] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.309376  7320 raft_consensus.cc:3060] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.307919  7285 consensus_queue.cc:260] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:26:46.309962  7203 consensus_peers.cc:597] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 -> Peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Couldn't send request to peer 022925662268440c91fff7e8732d7a0b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:46.311307  7287 tablet_bootstrap.cc:492] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:46.311818  7287 ts_tablet_manager.cc:1403] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.004s
I20260709 12:26:46.311183  7360 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.312862  7360 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.315141  7360 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:46.316699  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:46.317685  7287 raft_consensus.cc:359] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.318364  7287 raft_consensus.cc:385] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.318830  7287 raft_consensus.cc:740] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.317728  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:46.318418  7320 raft_consensus.cc:515] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:26:46.319955  6982 leader_election.cc:343] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.321925  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:46.321524  7089 raft_consensus.cc:2468] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:46.326169  7300 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.327306  7016 raft_consensus.cc:3060] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.327739  7300 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.319674  7287 consensus_queue.cc:260] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.328500  6982 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:46.332099  7300 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:46.322286  7285 ts_tablet_manager.cc:1434] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:26:46.333515  7285 tablet_bootstrap.cc:492] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:46.333935  7287 ts_tablet_manager.cc:1434] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:26:46.334416  7239 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:26:46.335155  7287 tablet_bootstrap.cc:492] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:46.335541  7293 raft_consensus.cc:2804] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.337076  7293 raft_consensus.cc:697] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:46.348793  7293 consensus_queue.cc:237] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.332010  7304 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.352844  7304 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:46.338056  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:46.353590  7015 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:46.354934  7202 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:46.355756  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:46.355834  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:46.356520  7090 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.340057  6980 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:46.357193  7304 raft_consensus.cc:2804] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.357625  7304 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.357969  7304 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.340541  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:46.358587  7091 raft_consensus.cc:3060] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.341218  7320 leader_election.cc:290] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:46.360515  7320 consensus_queue.cc:1048] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.365285  7090 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:46.345788  7016 raft_consensus.cc:2468] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:46.347478  7288 ts_tablet_manager.cc:1434] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.003s
I20260709 12:26:46.367206  7128 leader_election.cc:304] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:46.368091  7288 tablet_bootstrap.cc:492] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:46.368230  7205 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:46.370180  7320 raft_consensus.cc:2804] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.370853  7320 raft_consensus.cc:697] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:46.372036  7320 consensus_queue.cc:237] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:26:46.372874  7129 consensus_peers.cc:597] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b -> Peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Couldn't send request to peer e6a8a26eb5294e4cb87412a7f2698f41. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:46.373625  7300 raft_consensus.cc:2804] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.356436  7164 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.376178  7288 tablet_bootstrap.cc:654] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.381382  7360 raft_consensus.cc:2804] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.382014  7360 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.382465  7360 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.384864  7313 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.322736  7284 consensus_queue.cc:260] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:46.349852  7287 tablet_bootstrap.cc:654] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.350713  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:46.342779  7285 tablet_bootstrap.cc:654] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.365303  7304 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.385378  7313 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:46.385838  7321 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:46.403229  7205 leader_election.cc:343] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.392655  7300 raft_consensus.cc:697] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:46.408088  7288 tablet_bootstrap.cc:492] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:46.410966  7288 ts_tablet_manager.cc:1403] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.016s
I20260709 12:26:46.409430  7287 tablet_bootstrap.cc:492] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:46.412673  7287 ts_tablet_manager.cc:1403] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.004s
I20260709 12:26:46.410362  7284 ts_tablet_manager.cc:1434] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.112s	user 0.009s	sys 0.000s
I20260709 12:26:46.422379  7378 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.423292  7378 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.426556  7320 consensus_queue.cc:1048] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.430799  7304 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:46.410063  7321 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:46.431090  7288 raft_consensus.cc:359] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.431835  7288 raft_consensus.cc:385] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.431943  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:46.431994  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
W20260709 12:26:46.433832  7205 leader_election.cc:343] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.434305  7285 tablet_bootstrap.cc:492] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:46.434918  7285 ts_tablet_manager.cc:1403] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.013s
I20260709 12:26:46.436472  7300 consensus_queue.cc:237] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.439963  7287 raft_consensus.cc:359] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:46.440928  7287 raft_consensus.cc:385] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.441517  7287 raft_consensus.cc:740] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.432153  7288 raft_consensus.cc:740] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.443552  7284 tablet_bootstrap.cc:492] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:46.449774  7313 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:46.451774  7360 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.452095  7164 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:46.452786  7288 consensus_queue.cc:260] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.453567  7321 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:46.454533  7285 raft_consensus.cc:359] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:46.457980  7285 raft_consensus.cc:385] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.458248  7285 raft_consensus.cc:740] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.458619  7287 consensus_queue.cc:260] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:46.459376  7285 consensus_queue.cc:260] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:46.463762  7288 ts_tablet_manager.cc:1434] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.001s
I20260709 12:26:46.466630  7285 ts_tablet_manager.cc:1434] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.004s
I20260709 12:26:46.467329  7016 raft_consensus.cc:2393] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 1: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:26:46.467123  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:46.473724  7202 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:46.473925  7320 consensus_queue.cc:1048] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.467844  6912 catalog_manager.cc:5697] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 1 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.471505  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:46.472663  7285 tablet_bootstrap.cc:492] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:46.472517  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:46.472339  6913 catalog_manager.cc:5697] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.484522  7285 tablet_bootstrap.cc:654] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.484881  7091 raft_consensus.cc:2468] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:46.485951  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:46.474097  7239 raft_consensus.cc:2468] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:46.490271  7284 tablet_bootstrap.cc:654] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.475636  7321 raft_consensus.cc:2749] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.478164  7360 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:46.478879  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:46.480274  7164 raft_consensus.cc:2468] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:46.482204  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:46.481369  7014 raft_consensus.cc:2468] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:46.492188  7129 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:46.467005  7287 ts_tablet_manager.cc:1434] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.001s
I20260709 12:26:46.508929  7288 tablet_bootstrap.cc:492] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:46.517271  7238 raft_consensus.cc:2393] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 1: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:26:46.519369  7203 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
W20260709 12:26:46.519588  6982 leader_election.cc:343] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.520184  6982 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:46.521673  7287 tablet_bootstrap.cc:492] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:46.521469  7321 raft_consensus.cc:2804] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.524132  7321 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.524485  7321 raft_consensus.cc:3060] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.528204  7287 tablet_bootstrap.cc:654] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.529925  7360 raft_consensus.cc:2749] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.538628  7293 raft_consensus.cc:493] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.544724  7293 raft_consensus.cc:515] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:46.544870  7321 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:46.547555  7293 leader_election.cc:290] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:46.548972  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:46.549261  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:46.550375  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:46.550596  7285 tablet_bootstrap.cc:492] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:46.551594  7285 ts_tablet_manager.cc:1403] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.079s	user 0.018s	sys 0.014s
I20260709 12:26:46.561684  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:46.566180  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:26:46.557866  6980 leader_election.cc:343] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.566988  7238 raft_consensus.cc:2393] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 1: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
W20260709 12:26:46.567543  6980 leader_election.cc:343] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.567970  6980 leader_election.cc:304] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:46.550392  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:46.552650  7321 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:46.568831  7129 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:46.559130  7378 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:46.571636  7014 raft_consensus.cc:3060] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.572749  7313 raft_consensus.cc:3060] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.570148  7293 raft_consensus.cc:2749] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.595274  7379 raft_consensus.cc:2804] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.596094  7379 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.596581  7379 raft_consensus.cc:3060] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.607033  7288 tablet_bootstrap.cc:654] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.612587  7313 raft_consensus.cc:2749] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.615590  7300 raft_consensus.cc:493] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.616269  7300 raft_consensus.cc:515] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.619653  7379 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:46.621259  7163 raft_consensus.cc:2393] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 1: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:26:46.626996  7379 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:46.628438  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:46.630561  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:46.630157  7285 raft_consensus.cc:359] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:46.631063  7300 leader_election.cc:290] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:46.632983  7285 raft_consensus.cc:385] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.633275  7285 raft_consensus.cc:740] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.634145  7285 consensus_queue.cc:260] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:46.637761  7285 ts_tablet_manager.cc:1434] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.002s
I20260709 12:26:46.642326  7285 tablet_bootstrap.cc:492] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:46.644631  7238 raft_consensus.cc:2393] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 1: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:26:46.678613  7379 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.681432  7379 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:46.680294  7313 raft_consensus.cc:493] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.683149  7313 raft_consensus.cc:515] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:46.684255  7379 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:46.685104  7313 leader_election.cc:290] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:46.687920  7285 tablet_bootstrap.cc:654] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.711725  7287 tablet_bootstrap.cc:492] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:46.712111  7287 ts_tablet_manager.cc:1403] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.191s	user 0.020s	sys 0.010s
I20260709 12:26:46.713770  7284 tablet_bootstrap.cc:492] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:46.714210  7284 ts_tablet_manager.cc:1403] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.273s	user 0.015s	sys 0.003s
I20260709 12:26:46.715998  7285 tablet_bootstrap.cc:492] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:46.716094  7288 tablet_bootstrap.cc:492] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:46.716470  7285 ts_tablet_manager.cc:1403] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.008s
I20260709 12:26:46.716616  7288 ts_tablet_manager.cc:1403] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.215s	user 0.012s	sys 0.010s
I20260709 12:26:46.827591  7014 raft_consensus.cc:2468] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:46.839166  7202 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:26:46.839648  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:46.847682  7293 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.848261  7293 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:46.850355  7293 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:46.904268  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:46.905552  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:46.906262  7090 raft_consensus.cc:2468] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:46.906703  7379 consensus_queue.cc:1048] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.907675  7131 leader_election.cc:304] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
W20260709 12:26:46.908295  6982 leader_election.cc:343] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.908159  7293 consensus_queue.cc:1048] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:46.909389  7379 raft_consensus.cc:2804] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.909945  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:46.909849  7379 raft_consensus.cc:493] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.910754  7016 raft_consensus.cc:2393] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 1: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:26:46.910902  7379 raft_consensus.cc:3060] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.914361  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:46.916235  7131 leader_election.cc:343] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.918576  7379 raft_consensus.cc:515] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:46.926606  7394 consensus_queue.cc:1048] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.932080  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:46.932780  7091 raft_consensus.cc:3060] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.933858  7379 leader_election.cc:290] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:26:46.936492  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 97447.2us
I20260709 12:26:46.944439  7091 raft_consensus.cc:2468] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:46.936825  7321 raft_consensus.cc:2804] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.945379  7321 raft_consensus.cc:697] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
W20260709 12:26:46.945587  7202 leader_election.cc:343] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.945873  7131 leader_election.cc:304] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:46.937129  7304 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.946391  7321 consensus_queue.cc:237] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:46.948735  7313 raft_consensus.cc:2804] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.949303  7313 raft_consensus.cc:697] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:46.950119  7313 consensus_queue.cc:237] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:46.952466  7287 raft_consensus.cc:359] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:46.952236  6912 catalog_manager.cc:5697] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 1 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.953382  7287 raft_consensus.cc:385] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.953694  7287 raft_consensus.cc:740] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.954492  7287 consensus_queue.cc:260] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:46.963438  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:46.964215  7016 raft_consensus.cc:2468] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:46.964346  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:46.965067  7013 raft_consensus.cc:3060] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.969233  7128 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:46.943903  7393 consensus_queue.cc:1048] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:26:46.970459  7379 raft_consensus.cc:2749] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.946780  7304 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:46.973834  7379 consensus_queue.cc:1048] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:46.975539  7304 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:46.976594  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:46.977368  7014 raft_consensus.cc:2468] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:46.979351  7128 leader_election.cc:304] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:46.980580  7379 raft_consensus.cc:2804] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.980808  7238 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.981120  7379 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.981706  7379 raft_consensus.cc:3060] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.990096  7381 consensus_queue.cc:1048] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:46.994774  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:46.998596  7379 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:47.000941  7379 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:47.001745  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:47.002404  7014 raft_consensus.cc:3060] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.002177  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:26:47.003960  7131 leader_election.cc:343] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.011559  7014 raft_consensus.cc:2468] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:47.013265  7128 leader_election.cc:304] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:47.014683  7379 raft_consensus.cc:2804] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.015133  7321 consensus_queue.cc:1048] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.015408  7379 raft_consensus.cc:697] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:47.016391  7379 consensus_queue.cc:237] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:47.021040  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:47.019217  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:47.019558  7205 leader_election.cc:343] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.025964  7205 leader_election.cc:304] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:47.027370  7284 raft_consensus.cc:359] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.042445  7284 raft_consensus.cc:385] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.042900  7284 raft_consensus.cc:740] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.030568  7304 consensus_queue.cc:1048] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.032197  7300 consensus_queue.cc:1048] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.044059  7284 consensus_queue.cc:260] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.046602  7284 ts_tablet_manager.cc:1434] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.332s	user 0.009s	sys 0.001s
I20260709 12:26:47.048054  7284 tablet_bootstrap.cc:492] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:47.033097  7205 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:47.041255  7288 raft_consensus.cc:359] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:26:47.027877  6980 leader_election.cc:343] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.030073  7321 raft_consensus.cc:2749] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:47.050593  7285 raft_consensus.cc:359] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.051779  7288 raft_consensus.cc:385] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.053102  7285 raft_consensus.cc:385] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.053124  7288 raft_consensus.cc:740] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.053761  7285 raft_consensus.cc:740] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.052345  6980 leader_election.cc:304] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:47.056381  7288 consensus_queue.cc:260] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.064388  7285 consensus_queue.cc:260] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.067081  7285 ts_tablet_manager.cc:1434] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.350s	user 0.010s	sys 0.000s
I20260709 12:26:47.068209  7285 tablet_bootstrap.cc:492] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
W20260709 12:26:47.069284  6980 consensus_peers.cc:597] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 -> Peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Couldn't send request to peer e6a8a26eb5294e4cb87412a7f2698f41. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:47.061039  7293 raft_consensus.cc:2749] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:47.071759  7288 ts_tablet_manager.cc:1434] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.355s	user 0.012s	sys 0.000s
I20260709 12:26:47.073963  7288 tablet_bootstrap.cc:492] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:47.077035  7013 raft_consensus.cc:2468] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:47.085222  7287 ts_tablet_manager.cc:1434] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.373s	user 0.033s	sys 0.042s
I20260709 12:26:47.086432  7287 tablet_bootstrap.cc:492] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:47.093397  7287 tablet_bootstrap.cc:654] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.097672  7284 tablet_bootstrap.cc:654] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.112460  7285 tablet_bootstrap.cc:654] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:47.093997  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:47.122697  7288 tablet_bootstrap.cc:654] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.169673  7287 tablet_bootstrap.cc:492] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:47.171388  7287 ts_tablet_manager.cc:1403] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.001s
I20260709 12:26:47.174870  7285 tablet_bootstrap.cc:492] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:47.175625  7285 ts_tablet_manager.cc:1403] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.108s	user 0.007s	sys 0.009s
I20260709 12:26:47.178261  7284 tablet_bootstrap.cc:492] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:47.180709  7284 ts_tablet_manager.cc:1403] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.133s	user 0.015s	sys 0.001s
I20260709 12:26:47.190881  7284 raft_consensus.cc:359] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:47.191673  7284 raft_consensus.cc:385] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.191988  7284 raft_consensus.cc:740] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.193795  7285 raft_consensus.cc:359] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.194561  7285 raft_consensus.cc:385] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.194890  7285 raft_consensus.cc:740] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.195605  7285 consensus_queue.cc:260] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.198760  7287 raft_consensus.cc:359] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.199486  7287 raft_consensus.cc:385] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.199807  7287 raft_consensus.cc:740] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.201725  7287 consensus_queue.cc:260] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.200774  7284 consensus_queue.cc:260] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:47.206816  7285 ts_tablet_manager.cc:1434] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.028s	user 0.001s	sys 0.005s
I20260709 12:26:47.209714  6914 catalog_manager.cc:5697] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 1 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:47.217703  6914 catalog_manager.cc:5697] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 1 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:47.228772  7285 tablet_bootstrap.cc:492] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:47.229794  7284 ts_tablet_manager.cc:1434] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 12:26:47.231976  7284 tablet_bootstrap.cc:492] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:47.230811  7287 ts_tablet_manager.cc:1434] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 12:26:47.237399  7287 tablet_bootstrap.cc:492] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:47.255555  7284 tablet_bootstrap.cc:654] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.256556  7285 tablet_bootstrap.cc:654] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.258852  7300 raft_consensus.cc:2749] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:47.261474  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 93826.5us
I20260709 12:26:47.261986  7287 tablet_bootstrap.cc:654] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.262096  7288 tablet_bootstrap.cc:492] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:47.271368  7393 raft_consensus.cc:493] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.274689  7288 ts_tablet_manager.cc:1403] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.201s	user 0.013s	sys 0.006s
I20260709 12:26:47.274792  7393 raft_consensus.cc:515] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.277534  7288 raft_consensus.cc:359] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.278201  7288 raft_consensus.cc:385] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.278965  7288 raft_consensus.cc:740] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.278695  6912 catalog_manager.cc:5697] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 1 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.279642  7288 consensus_queue.cc:260] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.279865  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:47.281667  7288 ts_tablet_manager.cc:1434] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:47.282685  7288 tablet_bootstrap.cc:492] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:47.283744  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:47.289625  7288 tablet_bootstrap.cc:654] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.290517  7287 tablet_bootstrap.cc:492] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:47.291082  7287 ts_tablet_manager.cc:1403] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.000s
W20260709 12:26:47.290848  7054 leader_election.cc:343] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:47.292480  7055 leader_election.cc:343] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.293090  7055 leader_election.cc:304] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:47.294442  7287 raft_consensus.cc:359] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.295405  7287 raft_consensus.cc:385] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.295750  7287 raft_consensus.cc:740] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.297415  7393 leader_election.cc:290] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:47.298132  7394 raft_consensus.cc:2749] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:47.298332  7287 consensus_queue.cc:260] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.300343  7393 raft_consensus.cc:493] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.300926  7393 raft_consensus.cc:515] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:47.304186  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:47.304874  7014 raft_consensus.cc:2468] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 0.
I20260709 12:26:47.305572  7285 tablet_bootstrap.cc:492] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:47.306214  7285 ts_tablet_manager.cc:1403] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.078s	user 0.035s	sys 0.007s
I20260709 12:26:47.306313  7054 leader_election.cc:304] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:47.309163  7285 raft_consensus.cc:359] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.309880  7285 raft_consensus.cc:385] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.310146  7285 raft_consensus.cc:740] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.310985  7285 consensus_queue.cc:260] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.312111  7287 ts_tablet_manager.cc:1434] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:26:47.312438  7394 raft_consensus.cc:2804] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.312903  7394 raft_consensus.cc:493] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.313189  7287 tablet_bootstrap.cc:492] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:47.313270  7394 raft_consensus.cc:3060] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.314116  7399 raft_consensus.cc:493] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.314599  7399 raft_consensus.cc:515] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.316706  7285 ts_tablet_manager.cc:1434] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:26:47.316879  7399 leader_election.cc:290] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:47.318440  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:47.318804  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:47.319224  7238 raft_consensus.cc:2468] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
W20260709 12:26:47.320348  6982 leader_election.cc:343] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.321034  6980 leader_election.cc:304] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:47.322283  7399 raft_consensus.cc:2804] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.322695  7399 raft_consensus.cc:493] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.323065  7399 raft_consensus.cc:3060] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.324687  7287 tablet_bootstrap.cc:654] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.326790  7394 raft_consensus.cc:515] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:47.329866  7393 leader_election.cc:290] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:47.317924  7285 tablet_bootstrap.cc:492] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:47.331270  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:47.332060  7399 raft_consensus.cc:515] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:26:47.332829  7055 leader_election.cc:343] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.337453  7285 tablet_bootstrap.cc:654] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.339066  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:47.339812  7238 raft_consensus.cc:3060] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.340803  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:47.341481  7014 raft_consensus.cc:3060] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.344239  7284 tablet_bootstrap.cc:492] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:47.344910  7284 ts_tablet_manager.cc:1403] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.113s	user 0.018s	sys 0.005s
I20260709 12:26:47.349010  7300 raft_consensus.cc:493] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.349545  7300 raft_consensus.cc:515] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.351214  7014 raft_consensus.cc:2468] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:26:47.351747  7300 leader_election.cc:290] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:47.352595  7054 leader_election.cc:304] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:47.353593  7393 raft_consensus.cc:2804] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.353787  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:47.354182  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:47.354403  7393 raft_consensus.cc:697] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:26:47.354487  7163 raft_consensus.cc:2468] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:47.355435  7013 raft_consensus.cc:2468] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:47.355932  7203 leader_election.cc:304] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:47.357393  7394 leader_election.cc:290] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:47.357726  7288 tablet_bootstrap.cc:492] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:47.357951  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:47.358210  7288 ts_tablet_manager.cc:1403] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.076s	user 0.018s	sys 0.003s
I20260709 12:26:47.355491  7393 consensus_queue.cc:237] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:47.359378  7284 raft_consensus.cc:359] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.360280  7284 raft_consensus.cc:385] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.360631  7284 raft_consensus.cc:740] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
W20260709 12:26:47.359258  7055 leader_election.cc:343] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.361650  7300 raft_consensus.cc:2804] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.361491  7284 consensus_queue.cc:260] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.362023  7300 raft_consensus.cc:493] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.395943  7288 raft_consensus.cc:359] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.396775  7288 raft_consensus.cc:385] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.397104  7288 raft_consensus.cc:740] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.398227  7288 consensus_queue.cc:260] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.398934  7379 consensus_queue.cc:1048] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.400823  7288 ts_tablet_manager.cc:1434] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.042s	user 0.010s	sys 0.005s
I20260709 12:26:47.389276  7300 raft_consensus.cc:3060] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.403097  7288 tablet_bootstrap.cc:492] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:47.403980  7284 ts_tablet_manager.cc:1434] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.004s
I20260709 12:26:47.387553  7238 raft_consensus.cc:2468] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:47.414038  7284 tablet_bootstrap.cc:492] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:47.410897  7399 leader_election.cc:290] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:47.415871  7287 tablet_bootstrap.cc:492] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:47.416417  7287 ts_tablet_manager.cc:1403] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.103s	user 0.017s	sys 0.012s
I20260709 12:26:47.416513  7285 tablet_bootstrap.cc:492] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:47.417060  7285 ts_tablet_manager.cc:1403] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.014s
I20260709 12:26:47.419075  7287 raft_consensus.cc:359] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:47.419811  7287 raft_consensus.cc:385] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.419538  7285 raft_consensus.cc:359] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.420068  7287 raft_consensus.cc:740] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.420194  7285 raft_consensus.cc:385] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.420902  7287 consensus_queue.cc:260] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:47.423142  7287 ts_tablet_manager.cc:1434] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:26:47.424001  7417 consensus_queue.cc:1048] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:47.410030  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:47.424981  7090 raft_consensus.cc:3060] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.425546  7287 tablet_bootstrap.cc:492] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:47.426509  7288 tablet_bootstrap.cc:654] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.424119  6980 leader_election.cc:304] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:47.420787  7285 raft_consensus.cc:740] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.429708  7313 consensus_queue.cc:1048] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.429884  7285 consensus_queue.cc:260] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.430533  7399 raft_consensus.cc:2804] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.431239  7399 raft_consensus.cc:697] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:47.434283  7399 consensus_queue.cc:237] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.411515  7379 consensus_queue.cc:1048] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:26:47.436981  6914 catalog_manager.cc:5697] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66). New cstate: current_term: 1 leader_uuid: "9e6e5c8ad44447588681b10df7ad79ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.445621  7238 raft_consensus.cc:3060] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.447173  7284 tablet_bootstrap.cc:654] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.449316  7285 ts_tablet_manager.cc:1434] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.004s
I20260709 12:26:47.450917  7285 tablet_bootstrap.cc:492] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
W20260709 12:26:47.454017  7131 consensus_peers.cc:597] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b -> Peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Couldn't send request to peer 9e6e5c8ad44447588681b10df7ad79ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:47.455832  7379 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.456375  7379 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.465498  7285 tablet_bootstrap.cc:654] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.469386  7313 raft_consensus.cc:493] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.460878  7163 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.469919  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:47.470878  7313 raft_consensus.cc:515] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.474125  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:26:47.476030  7129 leader_election.cc:343] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.476080  7417 consensus_queue.cc:1048] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.478143  7313 leader_election.cc:290] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:47.478404  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:26:47.479898  7128 leader_election.cc:343] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.459060  7090 raft_consensus.cc:2468] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:47.490403  7287 tablet_bootstrap.cc:654] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.491333  7128 leader_election.cc:304] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:47.500624  7320 raft_consensus.cc:2749] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:47.502030  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:47.503777  7128 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:47.498903  7379 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:47.511698  6913 catalog_manager.cc:5697] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.523932  7288 tablet_bootstrap.cc:492] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:47.524492  7288 ts_tablet_manager.cc:1403] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.122s	user 0.026s	sys 0.006s
I20260709 12:26:47.527251  7288 raft_consensus.cc:359] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:47.527896  7288 raft_consensus.cc:385] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.528159  7288 raft_consensus.cc:740] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.528901  7288 consensus_queue.cc:260] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:47.531250  7288 ts_tablet_manager.cc:1434] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:47.532261  7288 tablet_bootstrap.cc:492] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:47.535526  7300 raft_consensus.cc:515] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.542454  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:47.543111  7164 raft_consensus.cc:3060] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.546921  7288 tablet_bootstrap.cc:654] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.562312  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:47.562973  7013 raft_consensus.cc:3060] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.565896  7300 leader_election.cc:290] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:47.572678  7285 tablet_bootstrap.cc:492] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:47.573338  7285 ts_tablet_manager.cc:1403] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.123s	user 0.023s	sys 0.015s
I20260709 12:26:47.579322  7285 raft_consensus.cc:359] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:47.580065  7285 raft_consensus.cc:385] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.580359  7285 raft_consensus.cc:740] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.581092  7285 consensus_queue.cc:260] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:47.585850  7399 raft_consensus.cc:493] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.586375  7399 raft_consensus.cc:515] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.590516  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:47.591437  7162 raft_consensus.cc:2468] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:26:47.590746  7164 raft_consensus.cc:2468] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:47.593156  7415 raft_consensus.cc:493] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.595978  7415 raft_consensus.cc:515] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.598058  7203 leader_election.cc:304] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:47.598093  7415 leader_election.cc:290] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:47.599391  7415 raft_consensus.cc:2804] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.599633  6980 leader_election.cc:304] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:47.599982  7415 raft_consensus.cc:697] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:47.600461  7293 raft_consensus.cc:2804] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.600987  7293 raft_consensus.cc:493] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.601019  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:47.593439  7399 leader_election.cc:290] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:47.601437  7293 raft_consensus.cc:3060] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.590591  7013 raft_consensus.cc:2468] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:47.601250  7415 consensus_queue.cc:237] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.603276  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:47.601720  7090 raft_consensus.cc:2468] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:47.604900  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:47.608597  7287 tablet_bootstrap.cc:492] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
W20260709 12:26:47.609025  7202 leader_election.cc:343] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.609242  7287 ts_tablet_manager.cc:1403] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.184s	user 0.017s	sys 0.001s
I20260709 12:26:47.617149  7417 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:47.617823  7417 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.622645  7287 raft_consensus.cc:359] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.623675  7287 raft_consensus.cc:385] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.624058  7287 raft_consensus.cc:740] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.624260  7293 raft_consensus.cc:515] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.583173  7285 ts_tablet_manager.cc:1434] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:26:47.626547  7293 leader_election.cc:290] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:47.627472  7285 tablet_bootstrap.cc:492] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
W20260709 12:26:47.628862  6980 leader_election.cc:343] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.617177  7284 tablet_bootstrap.cc:492] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:47.630839  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:47.631428  7164 raft_consensus.cc:3060] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.631930  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:47.634392  7288 tablet_bootstrap.cc:492] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:47.634838  7288 ts_tablet_manager.cc:1403] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.103s	user 0.026s	sys 0.001s
I20260709 12:26:47.637435  7288 raft_consensus.cc:359] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:47.638087  7288 raft_consensus.cc:385] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.638392  7288 raft_consensus.cc:740] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.638962  7288 consensus_queue.cc:260] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:47.639226  7164 raft_consensus.cc:2468] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:47.640527  6980 leader_election.cc:304] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:47.641080  7288 ts_tablet_manager.cc:1434] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:26:47.641351  7293 raft_consensus.cc:2804] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.641997  7293 raft_consensus.cc:697] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:47.642231  7288 tablet_bootstrap.cc:492] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:47.631024  7284 ts_tablet_manager.cc:1403] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.220s	user 0.016s	sys 0.011s
I20260709 12:26:47.642980  7293 consensus_queue.cc:237] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.645180  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:47.645059  7287 consensus_queue.cc:260] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.645560  7284 raft_consensus.cc:359] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.646229  7284 raft_consensus.cc:385] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.646497  7284 raft_consensus.cc:740] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.647264  7287 ts_tablet_manager.cc:1434] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:26:47.626049  7205 leader_election.cc:304] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:47.650156  7415 raft_consensus.cc:2804] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.650589  7415 raft_consensus.cc:493] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.651068  7415 raft_consensus.cc:3060] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.651211  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:47.654106  7288 tablet_bootstrap.cc:654] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.651124  7205 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:47.657871  7300 raft_consensus.cc:2749] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:47.648571  7287 tablet_bootstrap.cc:492] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
W20260709 12:26:47.659332  6980 leader_election.cc:343] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.666930  6913 catalog_manager.cc:5697] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 1 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.668253  7287 tablet_bootstrap.cc:654] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.670292  7285 tablet_bootstrap.cc:654] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.623888  7417 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:47.671566  7284 consensus_queue.cc:260] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.672501  7415 raft_consensus.cc:515] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.678761  7415 leader_election.cc:290] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:47.680142  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:47.680965  7090 raft_consensus.cc:3060] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.684142  7415 raft_consensus.cc:493] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.684630  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:47.684934  7415 raft_consensus.cc:515] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:26:47.686035  7202 leader_election.cc:343] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.686818  7417 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.687323  7417 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:47.689303  7090 raft_consensus.cc:2468] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:47.690608  7205 leader_election.cc:304] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:47.691418  7300 raft_consensus.cc:2804] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.691876  7300 raft_consensus.cc:697] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:47.692734  7300 consensus_queue.cc:237] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.693487  7284 ts_tablet_manager.cc:1434] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.002s
I20260709 12:26:47.694715  7284 tablet_bootstrap.cc:492] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:47.696396  7287 tablet_bootstrap.cc:492] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:47.697281  7287 ts_tablet_manager.cc:1403] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.003s
I20260709 12:26:47.700286  7387 raft_consensus.cc:2749] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:47.719322  7417 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:47.720746  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:47.722193  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:47.721609  7164 raft_consensus.cc:2468] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
W20260709 12:26:47.723852  7205 leader_election.cc:343] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.722409  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:47.724509  7186 debug-util.cc:398] Leaking SignalData structure 0x7b0800142380 after lost signal to thread 3876
W20260709 12:26:47.725844  7186 debug-util.cc:398] Leaking SignalData structure 0x7b0800244700 after lost signal to thread 6948
I20260709 12:26:47.726048  7203 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:47.727361  7417 raft_consensus.cc:2804] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:26:47.727492  7186 debug-util.cc:398] Leaking SignalData structure 0x7b0800146fa0 after lost signal to thread 7040
I20260709 12:26:47.727844  7417 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.728484  7417 raft_consensus.cc:3060] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:47.729090  7186 debug-util.cc:398] Leaking SignalData structure 0x7b0800271160 after lost signal to thread 7115
W20260709 12:26:47.730602  7186 debug-util.cc:398] Leaking SignalData structure 0x7b08000d3d20 after lost signal to thread 7189
I20260709 12:26:47.731228  7399 raft_consensus.cc:493] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.731703  7399 raft_consensus.cc:515] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:26:47.732034  7186 debug-util.cc:398] Leaking SignalData structure 0x7b08000d4fc0 after lost signal to thread 7263
W20260709 12:26:47.733455  7205 leader_election.cc:343] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.733952  7399 leader_election.cc:290] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:47.736516  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:26:47.738034  6980 leader_election.cc:343] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.739195  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:47.739989  7164 raft_consensus.cc:2468] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:26:47.746040  7284 tablet_bootstrap.cc:654] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.746908  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:26:47.748656  7203 leader_election.cc:343] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.749264  7203 leader_election.cc:304] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:47.750948  7300 raft_consensus.cc:2749] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:47.751965  7415 leader_election.cc:290] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:47.753047  6914 catalog_manager.cc:5697] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:47.753381  7287 raft_consensus.cc:359] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:47.754484  7287 raft_consensus.cc:385] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.754925  7287 raft_consensus.cc:740] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.755993  7287 consensus_queue.cc:260] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:47.758276  6980 leader_election.cc:304] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:47.761952  7287 ts_tablet_manager.cc:1434] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 12:26:47.762979  7399 raft_consensus.cc:2804] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.771600  7399 raft_consensus.cc:493] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.772058  7399 raft_consensus.cc:3060] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.776537  6913 catalog_manager.cc:5697] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 1 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.787307  7399 raft_consensus.cc:515] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.789829  7285 tablet_bootstrap.cc:492] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:47.790536  7285 ts_tablet_manager.cc:1403] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.163s	user 0.009s	sys 0.012s
I20260709 12:26:47.791589  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:47.792935  7287 tablet_bootstrap.cc:492] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:47.790117  7399 leader_election.cc:290] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:47.793939  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:47.792199  7164 raft_consensus.cc:3060] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:47.795346  6980 leader_election.cc:343] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.796271  7393 consensus_queue.cc:1048] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:47.797063  7417 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:47.799540  7285 raft_consensus.cc:359] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:47.800248  7285 raft_consensus.cc:385] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.800539  7285 raft_consensus.cc:740] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.801379  7285 consensus_queue.cc:260] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:47.803411  7164 raft_consensus.cc:2468] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:47.804615  6980 leader_election.cc:304] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:47.805488  7293 raft_consensus.cc:2804] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.805999  7293 raft_consensus.cc:697] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:47.806849  7293 consensus_queue.cc:237] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.808204  7288 tablet_bootstrap.cc:492] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:47.808696  7288 ts_tablet_manager.cc:1403] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.167s	user 0.056s	sys 0.079s
I20260709 12:26:47.809489  7285 ts_tablet_manager.cc:1434] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 12:26:47.810578  7285 tablet_bootstrap.cc:492] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:47.811851  7288 raft_consensus.cc:359] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.812568  7288 raft_consensus.cc:385] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.812850  7288 raft_consensus.cc:740] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.813537  7288 consensus_queue.cc:260] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.815784  7288 ts_tablet_manager.cc:1434] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:26:47.816255  7284 tablet_bootstrap.cc:492] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:47.816830  7284 ts_tablet_manager.cc:1403] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.122s	user 0.024s	sys 0.010s
I20260709 12:26:47.816900  7288 tablet_bootstrap.cc:492] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:47.819693  7284 raft_consensus.cc:359] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:47.823004  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:47.841135  7284 raft_consensus.cc:385] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.823655  7288 tablet_bootstrap.cc:654] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.824962  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:47.841959  7164 raft_consensus.cc:3060] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.841482  7284 raft_consensus.cc:740] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.827435  7287 tablet_bootstrap.cc:654] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.823729  7417 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:47.834506  7285 tablet_bootstrap.cc:654] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:47.838059  7055 consensus_peers.cc:597] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca -> Peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Couldn't send request to peer 022925662268440c91fff7e8732d7a0b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:47.842835  7284 consensus_queue.cc:260] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:26:47.847254  7205 leader_election.cc:343] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.852809  7399 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.853389  7399 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:47.857081  6914 catalog_manager.cc:5697] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:47.858758  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:47.858994  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:47.859611  7163 raft_consensus.cc:2468] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:26:47.860260  7399 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:26:47.860488  6982 leader_election.cc:343] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.861229  6980 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:47.865643  7164 raft_consensus.cc:2468] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:47.866030  7450 raft_consensus.cc:2804] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.866532  7450 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.866866  7450 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.867419  7203 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:47.869228  7417 raft_consensus.cc:2804] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.869900  7417 raft_consensus.cc:697] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:47.871016  7417 consensus_queue.cc:237] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:47.877075  7287 tablet_bootstrap.cc:492] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:47.877606  7287 ts_tablet_manager.cc:1403] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.113s	user 0.014s	sys 0.004s
I20260709 12:26:47.880524  7287 raft_consensus.cc:359] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.881261  7287 raft_consensus.cc:385] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.881521  7287 raft_consensus.cc:740] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.881685  7284 ts_tablet_manager.cc:1434] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 12:26:47.883116  7284 tablet_bootstrap.cc:492] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:47.884311  7287 consensus_queue.cc:260] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.887233  7285 tablet_bootstrap.cc:492] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:47.887729  7285 ts_tablet_manager.cc:1403] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.001s
I20260709 12:26:47.891247  7285 raft_consensus.cc:359] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:47.891866  7285 raft_consensus.cc:385] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.892148  7285 raft_consensus.cc:740] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.896624  7288 tablet_bootstrap.cc:492] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:47.900619  7288 ts_tablet_manager.cc:1403] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.084s	user 0.030s	sys 0.018s
I20260709 12:26:47.897336  7450 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:47.903513  7288 raft_consensus.cc:359] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.904017  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:47.900676  7284 tablet_bootstrap.cc:654] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:47.905603  6982 leader_election.cc:343] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.898343  7285 consensus_queue.cc:260] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:47.904265  7288 raft_consensus.cc:385] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.898115  7287 ts_tablet_manager.cc:1434] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 12:26:47.907209  7288 raft_consensus.cc:740] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.908159  7288 consensus_queue.cc:260] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.910096  7288 ts_tablet_manager.cc:1434] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:26:47.911005  7288 tablet_bootstrap.cc:492] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:47.911219  6912 catalog_manager.cc:5697] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 1 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:47.917011  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:47.917789  7164 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.918959  7285 ts_tablet_manager.cc:1434] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:26:47.909299  7450 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:47.919688  7287 tablet_bootstrap.cc:492] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:47.920020  7285 tablet_bootstrap.cc:492] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:47.922674  7450 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.923245  7450 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:47.926822  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:26:47.928416  6980 leader_election.cc:343] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.929065  7450 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:47.930156  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:47.933876  6982 leader_election.cc:343] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.934322  6982 leader_election.cc:304] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:47.931401  7288 tablet_bootstrap.cc:654] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.935477  7360 raft_consensus.cc:2749] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:47.939438  7360 consensus_queue.cc:1048] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.945771  7288 tablet_bootstrap.cc:492] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:47.947927  7284 tablet_bootstrap.cc:492] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:47.948050  7164 raft_consensus.cc:2468] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:47.948536  7284 ts_tablet_manager.cc:1403] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.066s	user 0.006s	sys 0.014s
I20260709 12:26:47.949759  7285 tablet_bootstrap.cc:654] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.949590  6980 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:47.950819  7450 raft_consensus.cc:2804] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.951253  7284 raft_consensus.cc:359] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:47.946403  7288 ts_tablet_manager.cc:1403] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.008s
I20260709 12:26:47.953523  7284 raft_consensus.cc:385] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.953853  7284 raft_consensus.cc:740] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.954566  7284 consensus_queue.cc:260] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:47.956506  7288 raft_consensus.cc:359] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:47.957203  7288 raft_consensus.cc:385] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.957444  7288 raft_consensus.cc:740] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.958192  7288 consensus_queue.cc:260] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:47.959656  7288 ts_tablet_manager.cc:1434] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:26:47.960582  7288 tablet_bootstrap.cc:492] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:47.961321  7284 ts_tablet_manager.cc:1434] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 12:26:47.963523  7284 tablet_bootstrap.cc:492] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:47.966399  7288 tablet_bootstrap.cc:654] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.964181  7450 raft_consensus.cc:697] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:47.967427  7450 consensus_queue.cc:237] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:47.970230  7285 tablet_bootstrap.cc:492] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:47.970733  7285 ts_tablet_manager.cc:1403] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.051s	user 0.002s	sys 0.007s
I20260709 12:26:47.973536  7285 raft_consensus.cc:359] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.974169  7285 raft_consensus.cc:385] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.974445  7285 raft_consensus.cc:740] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.975247  7285 consensus_queue.cc:260] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:47.976016  7287 tablet_bootstrap.cc:654] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.978582  7288 tablet_bootstrap.cc:492] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:47.979112  7288 ts_tablet_manager.cc:1403] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:26:47.980254  7284 tablet_bootstrap.cc:654] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.982293  7285 ts_tablet_manager.cc:1434] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:26:47.981949  7288 raft_consensus.cc:359] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.982784  7288 raft_consensus.cc:385] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.983338  7288 raft_consensus.cc:740] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.983531  7285 tablet_bootstrap.cc:492] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:47.984102  7288 consensus_queue.cc:260] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.986290  7288 ts_tablet_manager.cc:1434] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:47.987287  7288 tablet_bootstrap.cc:492] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:47.995015  7287 tablet_bootstrap.cc:492] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:47.995666  7287 ts_tablet_manager.cc:1403] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.079s	user 0.007s	sys 0.007s
I20260709 12:26:47.998618  7287 raft_consensus.cc:359] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:47.999346  7287 raft_consensus.cc:385] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.999619  7287 raft_consensus.cc:740] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.000319  7288 tablet_bootstrap.cc:654] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.000383  7287 consensus_queue.cc:260] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.003264  7287 ts_tablet_manager.cc:1434] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:48.004379  7287 tablet_bootstrap.cc:492] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:48.009964  7415 raft_consensus.cc:493] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.010504  7415 raft_consensus.cc:515] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:48.012585  7415 leader_election.cc:290] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:48.014248  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:48.017807  7284 tablet_bootstrap.cc:492] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:48.019156  7284 ts_tablet_manager.cc:1403] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.001s
I20260709 12:26:48.019213  7394 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.019788  7394 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:48.020504  6912 catalog_manager.cc:5697] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.021924  7394 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:48.022303  7284 raft_consensus.cc:359] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:48.022989  7284 raft_consensus.cc:385] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.023281  7284 raft_consensus.cc:740] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.023783  7284 consensus_queue.cc:260] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:48.025954  7284 ts_tablet_manager.cc:1434] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:26:48.026012  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:48.026554  7387 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.027150  7164 raft_consensus.cc:2393] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 1: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:26:48.027094  7387 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.028447  7203 leader_election.cc:304] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:48.028607  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:48.029263  7387 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:48.030159  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:48.030818  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:48.034036  7285 tablet_bootstrap.cc:654] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.035938  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:48.040418  7054 leader_election.cc:304] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:48.041356  7288 tablet_bootstrap.cc:492] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:48.041895  7288 ts_tablet_manager.cc:1403] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.004s
I20260709 12:26:48.042023  7359 raft_consensus.cc:2749] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:48.042922  7131 leader_election.cc:343] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:48.043493  7129 leader_election.cc:343] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.043938  7129 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:48.045086  7387 raft_consensus.cc:2749] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.044998  7288 raft_consensus.cc:359] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.045871  7288 raft_consensus.cc:385] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.046152  7288 raft_consensus.cc:740] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.046795  7415 raft_consensus.cc:3060] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.047422  7284 tablet_bootstrap.cc:492] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:48.047256  7449 consensus_queue.cc:1048] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.046826  7288 consensus_queue.cc:260] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.054435  7284 tablet_bootstrap.cc:654] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.055660  7288 ts_tablet_manager.cc:1434] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:26:48.056738  7288 tablet_bootstrap.cc:492] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:48.057804  7300 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.058538  7300 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.061542  7300 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:48.063691  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:48.064893  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:48.064992  7387 raft_consensus.cc:493] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.066087  7387 raft_consensus.cc:515] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:26:48.066900  7205 leader_election.cc:343] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.028647  7287 tablet_bootstrap.cc:654] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.072396  7288 tablet_bootstrap.cc:654] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.062708  7415 raft_consensus.cc:2749] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.074427  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:48.075326  7239 raft_consensus.cc:2468] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:48.076892  7129 leader_election.cc:304] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:48.077999  7379 raft_consensus.cc:2804] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.078446  7379 raft_consensus.cc:493] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.078794  7379 raft_consensus.cc:3060] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.081429  7287 tablet_bootstrap.cc:492] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:48.081949  7287 ts_tablet_manager.cc:1403] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.078s	user 0.005s	sys 0.008s
I20260709 12:26:48.084893  7284 tablet_bootstrap.cc:492] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:48.084745  7287 raft_consensus.cc:359] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:48.085417  7284 ts_tablet_manager.cc:1403] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.038s	user 0.025s	sys 0.012s
I20260709 12:26:48.085426  7287 raft_consensus.cc:385] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.085894  7287 raft_consensus.cc:740] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.088418  7288 tablet_bootstrap.cc:492] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:48.088341  7284 raft_consensus.cc:359] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.089012  7288 ts_tablet_manager.cc:1403] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 12:26:48.089236  7284 raft_consensus.cc:385] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.089605  7284 raft_consensus.cc:740] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.090437  7284 consensus_queue.cc:260] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.091828  7288 raft_consensus.cc:359] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.092497  7288 raft_consensus.cc:385] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.092792  7288 raft_consensus.cc:740] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
W20260709 12:26:48.093120  7203 leader_election.cc:343] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.093133  7284 ts_tablet_manager.cc:1434] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:48.093808  7203 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:48.094632  7284 tablet_bootstrap.cc:492] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:48.094762  7415 raft_consensus.cc:2749] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.094519  7288 consensus_queue.cc:260] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.093593  7287 consensus_queue.cc:260] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:48.096134  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:48.096702  7287 ts_tablet_manager.cc:1434] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:26:48.097411  7387 leader_election.cc:290] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:48.099242  7287 tablet_bootstrap.cc:492] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:48.101240  7284 tablet_bootstrap.cc:654] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:48.102279  7131 leader_election.cc:343] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.105791  7287 tablet_bootstrap.cc:654] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.109594  7288 ts_tablet_manager.cc:1434] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:26:48.111361  7288 tablet_bootstrap.cc:492] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:48.112753  7284 tablet_bootstrap.cc:492] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:48.113341  7284 ts_tablet_manager.cc:1403] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 12:26:48.113852  7359 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.114388  7359 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.116110  7284 raft_consensus.cc:359] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.116509  7359 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:48.119174  7288 tablet_bootstrap.cc:654] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.117969  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:48.120383  7239 raft_consensus.cc:2393] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 1: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:26:48.119357  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:48.116825  7284 raft_consensus.cc:385] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.121907  7015 raft_consensus.cc:2393] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 1: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:26:48.123301  7054 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:48.124938  7359 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.133095  7359 raft_consensus.cc:2749] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:48.133306  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:48.122032  7284 raft_consensus.cc:740] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.139348  7287 tablet_bootstrap.cc:492] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:48.139966  7287 ts_tablet_manager.cc:1403] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.011s
I20260709 12:26:48.140226  7284 consensus_queue.cc:260] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.142822  7284 ts_tablet_manager.cc:1434] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:26:48.142719  7287 raft_consensus.cc:359] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.143499  7287 raft_consensus.cc:385] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.143805  7287 raft_consensus.cc:740] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.143980  7284 tablet_bootstrap.cc:492] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:48.144819  7287 consensus_queue.cc:260] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.148185  7287 ts_tablet_manager.cc:1434] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:48.124320  7379 raft_consensus.cc:515] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.150869  7284 tablet_bootstrap.cc:654] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.152976  7287 tablet_bootstrap.cc:492] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:48.154251  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:26:48.156167  7131 leader_election.cc:343] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.157917  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:48.158567  7239 raft_consensus.cc:3060] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.164780  7284 tablet_bootstrap.cc:492] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:48.165310  7287 tablet_bootstrap.cc:654] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.165308  7284 ts_tablet_manager.cc:1403] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.002s
I20260709 12:26:48.167407  7239 raft_consensus.cc:2468] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:48.169166  7129 leader_election.cc:304] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:48.168363  7284 raft_consensus.cc:359] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:48.170266  7313 raft_consensus.cc:2804] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.170266  7284 raft_consensus.cc:385] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.170826  7284 raft_consensus.cc:740] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.170883  7313 raft_consensus.cc:697] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:48.171597  7284 consensus_queue.cc:260] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:48.172072  7313 consensus_queue.cc:237] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.172837  7300 consensus_queue.cc:1048] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.174162  7284 ts_tablet_manager.cc:1434] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:48.175258  7284 tablet_bootstrap.cc:492] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:48.181612  7284 tablet_bootstrap.cc:654] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.189343  7450 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.189987  7450 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:48.193061  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:48.194535  6982 leader_election.cc:343] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.195832  7450 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:48.203825  7379 leader_election.cc:290] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:48.203661  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:48.204666  7300 consensus_queue.cc:1048] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:26:48.205651  6980 leader_election.cc:343] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.206097  6980 leader_election.cc:304] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:48.207377  7450 raft_consensus.cc:2749] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.211028  7450 consensus_queue.cc:1048] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.218297  7300 consensus_queue.cc:1048] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.201977  7387 raft_consensus.cc:493] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:48.222837  6980 consensus_peers.cc:597] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 -> Peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Couldn't send request to peer e6a8a26eb5294e4cb87412a7f2698f41. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:48.232869  7387 raft_consensus.cc:515] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:48.234688  7415 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.235210  7415 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.235390  7449 consensus_queue.cc:1048] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.237241  7415 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:48.237407  7387 leader_election.cc:290] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:48.238351  7450 raft_consensus.cc:493] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.238471  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:48.238883  7450 raft_consensus.cc:515] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.239303  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:48.239370  7239 raft_consensus.cc:2468] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:48.240018  7013 raft_consensus.cc:2468] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:48.240902  7129 leader_election.cc:304] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:48.242880  7450 leader_election.cc:290] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:48.243615  7387 raft_consensus.cc:2804] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.248713  7287 tablet_bootstrap.cc:492] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:48.249454  7287 ts_tablet_manager.cc:1403] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.004s
I20260709 12:26:48.250018  6913 catalog_manager.cc:5697] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 1 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.256863  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:48.246467  7202 leader_election.cc:304] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:48.247231  7387 raft_consensus.cc:493] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.249203  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:48.261382  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:48.265506  7387 raft_consensus.cc:3060] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.264123  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:48.273085  6982 leader_election.cc:304] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:48.274520  7417 raft_consensus.cc:2804] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.291436  7417 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.263568  7090 raft_consensus.cc:2468] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:48.279349  7284 tablet_bootstrap.cc:492] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:48.292500  7013 raft_consensus.cc:2468] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:48.293434  7284 ts_tablet_manager.cc:1403] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.118s	user 0.025s	sys 0.019s
I20260709 12:26:48.295758  7013 raft_consensus.cc:3060] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.296893  7284 raft_consensus.cc:359] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.297602  7284 raft_consensus.cc:385] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.297866  7284 raft_consensus.cc:740] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.298566  7284 consensus_queue.cc:260] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.293057  7417 raft_consensus.cc:3060] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.306188  7284 ts_tablet_manager.cc:1434] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:26:48.313592  7285 tablet_bootstrap.cc:492] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:48.314173  7285 ts_tablet_manager.cc:1403] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.331s	user 0.011s	sys 0.002s
I20260709 12:26:48.317148  7449 raft_consensus.cc:2749] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.318483  7300 consensus_queue.cc:1048] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.319918  7417 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.324281  7284 tablet_bootstrap.cc:492] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:48.327683  7285 raft_consensus.cc:359] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:48.329664  7285 raft_consensus.cc:385] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.330144  7285 raft_consensus.cc:740] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.334964  7285 consensus_queue.cc:260] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:48.338335  7450 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.338088  7387 raft_consensus.cc:515] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:48.338878  7450 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.340688  7387 leader_election.cc:290] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:48.341360  7288 tablet_bootstrap.cc:492] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:48.350684  7288 ts_tablet_manager.cc:1403] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.240s	user 0.033s	sys 0.043s
I20260709 12:26:48.341667  7450 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:48.342305  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:48.343142  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:48.344360  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:48.344964  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:48.357967  7015 raft_consensus.cc:3060] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.359045  7236 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:26:48.354827  7288 raft_consensus.cc:359] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.360051  7288 raft_consensus.cc:385] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.360430  7288 raft_consensus.cc:740] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.361451  7288 consensus_queue.cc:260] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.366078  7288 ts_tablet_manager.cc:1434] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:26:48.368574  7483 consensus_queue.cc:1048] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:26:48.368477  7015 raft_consensus.cc:2468] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:48.378752  7128 leader_election.cc:304] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:48.379796  7379 raft_consensus.cc:2804] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.380255  7379 raft_consensus.cc:697] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:48.381083  7379 consensus_queue.cc:237] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:48.389174  7417 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:48.348589  7285 ts_tablet_manager.cc:1434] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.005s
W20260709 12:26:48.353699  6982 leader_election.cc:343] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.391932  7285 tablet_bootstrap.cc:492] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:48.352352  7239 raft_consensus.cc:3060] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.394423  6980 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:48.397430  7450 raft_consensus.cc:2804] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.398476  7450 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.398859  7450 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.398970  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:48.399700  7090 raft_consensus.cc:3060] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.396939  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:48.401037  7015 raft_consensus.cc:3060] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.400913  7287 raft_consensus.cc:359] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.401630  7287 raft_consensus.cc:385] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.401901  7287 raft_consensus.cc:740] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.403173  7091 raft_consensus.cc:3060] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.405100  7284 tablet_bootstrap.cc:654] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.406937  7359 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.407595  7359 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:48.410935  7359 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:48.412789  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:48.417063  7287 consensus_queue.cc:260] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.416513  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:48.419279  7417 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.419584  7287 ts_tablet_manager.cc:1434] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.170s	user 0.007s	sys 0.003s
I20260709 12:26:48.419679  7163 raft_consensus.cc:2393] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 1: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:26:48.419800  7417 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.420742  7287 tablet_bootstrap.cc:492] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:48.421798  7055 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:48.422087  7417 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:48.425058  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:48.425856  7163 raft_consensus.cc:2468] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:48.426007  7239 raft_consensus.cc:2468] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:48.427070  7287 tablet_bootstrap.cc:654] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.427636  7203 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:48.428715  7015 raft_consensus.cc:2468] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:48.429942  7202 leader_election.cc:304] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:48.430428  7417 raft_consensus.cc:2804] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.430887  7417 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.431136  7300 raft_consensus.cc:2804] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.431957  7300 raft_consensus.cc:697] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:48.432725  7449 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.433267  7449 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.433085  7300 consensus_queue.cc:237] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.435724  7449 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:48.431265  7417 raft_consensus.cc:3060] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.441849  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:48.448303  7449 consensus_queue.cc:1048] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:48.483878  7288 tablet_bootstrap.cc:492] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:48.442550  7359 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.498977  7359 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.504000  7359 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:48.504689  7359 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.526741  7088 raft_consensus.cc:3060] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.529975  7415 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.530563  7415 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.539455  7394 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.540163  7394 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.496397  7089 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:48.544272  7394 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:48.564119  7360 raft_consensus.cc:493] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.571201  7360 raft_consensus.cc:515] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.575870  7360 leader_election.cc:290] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:26:48.551813  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 130123us
I20260709 12:26:48.565228  7417 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.586249  7284 tablet_bootstrap.cc:492] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:48.586771  7284 ts_tablet_manager.cc:1403] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.263s	user 0.018s	sys 0.016s
I20260709 12:26:48.587498  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:48.589692  7284 raft_consensus.cc:359] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.590402  7284 raft_consensus.cc:385] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.590677  7284 raft_consensus.cc:740] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
W20260709 12:26:48.591130  7203 leader_election.cc:343] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.591341  7284 consensus_queue.cc:260] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.591367  6913 catalog_manager.cc:5697] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 1 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.592491  7417 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:48.593695  7284 ts_tablet_manager.cc:1434] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:26:48.594673  7284 tablet_bootstrap.cc:492] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:48.594616  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:48.598340  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:48.598920  7087 raft_consensus.cc:3060] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.568298  7090 raft_consensus.cc:2468] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:48.581328  7415 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:48.608789  7287 tablet_bootstrap.cc:492] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:48.609486  7287 ts_tablet_manager.cc:1403] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.189s	user 0.060s	sys 0.070s
I20260709 12:26:48.600709  7450 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.611222  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:48.616971  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:48.619611  7205 leader_election.cc:343] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.627408  7394 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.630381  7165 raft_consensus.cc:2468] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 0.
I20260709 12:26:48.646631  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:48.625128  7493 consensus_queue.cc:1048] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:26:48.652033  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:48.655439  7239 raft_consensus.cc:2393] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 1: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:26:48.646257  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:48.658182  7313 consensus_queue.cc:1048] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.656389  7164 raft_consensus.cc:3060] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.659343  7285 tablet_bootstrap.cc:654] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.660104  7313 raft_consensus.cc:493] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.660624  7313 raft_consensus.cc:515] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:48.645757  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:48.648654  7492 raft_consensus.cc:493] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.668221  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:48.642630  6982 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:48.680519  7287 raft_consensus.cc:359] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:48.681545  7287 raft_consensus.cc:385] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.681914  7287 raft_consensus.cc:740] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.682898  7287 consensus_queue.cc:260] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:48.687422  7287 ts_tablet_manager.cc:1434] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
I20260709 12:26:48.668844  7313 leader_election.cc:290] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:48.688623  7287 tablet_bootstrap.cc:492] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:48.692682  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:48.694197  7055 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:48.695888  7287 tablet_bootstrap.cc:654] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:48.698278  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 65516.8us
I20260709 12:26:48.698499  7495 raft_consensus.cc:2804] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:48.699137  7495 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.699558  7495 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.704526  7288 tablet_bootstrap.cc:654] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.692132  7087 raft_consensus.cc:2468] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:48.646046  7205 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:48.649474  7394 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:48.712450  6914 catalog_manager.cc:5697] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 1 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.714572  7415 raft_consensus.cc:2749] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.716266  7489 raft_consensus.cc:2764] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:26:48.730604  7055 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:26:48.729655  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 112824us
I20260709 12:26:48.737547  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:48.738317  7236 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:48.678385  7492 raft_consensus.cc:515] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.744311  7450 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:48.744235  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:48.745750  7164 raft_consensus.cc:2468] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:48.727810  7359 raft_consensus.cc:2749] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.752712  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:48.753425  7087 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.750128  7495 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.750739  7360 consensus_queue.cc:1048] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:48.751600  6982 leader_election.cc:343] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.748255  7489 raft_consensus.cc:2749] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:48.756776  7495 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:48.757257  7394 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:48.765713  7284 tablet_bootstrap.cc:654] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.772502  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:48.781947  7450 raft_consensus.cc:493] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.782593  7450 raft_consensus.cc:515] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:48.784880  7450 leader_election.cc:290] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:48.785748  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:48.786652  7492 leader_election.cc:290] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:48.786757  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:26:48.788371  6980 leader_election.cc:343] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.802073  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:48.802537  7203 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:48.803100  7088 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.803691  7415 raft_consensus.cc:2804] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.804225  7415 raft_consensus.cc:697] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:48.805877  7087 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:48.808754  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:48.809149  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:48.809762  7415 consensus_queue.cc:237] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.812207  7091 raft_consensus.cc:3060] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:48.812544  7055 leader_election.cc:343] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.814096  7055 leader_election.cc:304] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:48.823429  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:48.824285  7013 raft_consensus.cc:2468] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 0.
I20260709 12:26:48.824369  6982 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:48.825469  7128 leader_election.cc:304] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:48.830214  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:48.830960  7387 raft_consensus.cc:2749] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.831456  7450 raft_consensus.cc:2804] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.832011  7450 raft_consensus.cc:697] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:48.844316  7450 consensus_queue.cc:237] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:48.831010  7238 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.850987  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:48.851835  7236 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.835253  7495 consensus_queue.cc:1048] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:26:48.859180  7054 leader_election.cc:304] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:26:48.859639  7088 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:26:48.860806  7502 raft_consensus.cc:2804] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.865128  7502 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.865543  7502 raft_consensus.cc:3060] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.866835  7287 tablet_bootstrap.cc:492] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:48.867332  7287 ts_tablet_manager.cc:1403] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.179s	user 0.009s	sys 0.027s
I20260709 12:26:48.872602  7165 raft_consensus.cc:3060] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.875205  7238 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:48.879070  7500 raft_consensus.cc:2749] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.882287  7496 consensus_queue.cc:1048] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.885172  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:48.902192  7287 raft_consensus.cc:359] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:48.903254  7287 raft_consensus.cc:385] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.903635  7287 raft_consensus.cc:740] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.886351  7236 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
W20260709 12:26:48.909546  6980 leader_election.cc:343] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.910107  6980 leader_election.cc:304] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:48.910418  7313 consensus_queue.cc:1048] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.913981  6982 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:48.916913  6914 catalog_manager.cc:5697] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 1 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:48.886272  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 80731.6us
I20260709 12:26:48.923146  7287 consensus_queue.cc:260] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:48.926378  7285 tablet_bootstrap.cc:492] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:48.926810  7285 ts_tablet_manager.cc:1403] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.535s	user 0.029s	sys 0.029s
I20260709 12:26:48.933496  7284 tablet_bootstrap.cc:492] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:48.934851  7284 ts_tablet_manager.cc:1403] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.340s	user 0.019s	sys 0.007s
I20260709 12:26:48.936040  7288 tablet_bootstrap.cc:492] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:48.936511  7288 ts_tablet_manager.cc:1403] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.487s	user 0.025s	sys 0.021s
I20260709 12:26:48.920032  7399 raft_consensus.cc:2749] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.925743  7495 raft_consensus.cc:2804] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:48.958104  7287 ts_tablet_manager.cc:1434] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.002s
W20260709 12:26:48.941841  6980 leader_election.cc:343] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.959149  7284 raft_consensus.cc:359] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:48.960690  7284 raft_consensus.cc:385] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.960354  6980 leader_election.cc:304] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:48.949656  7502 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:48.963943  7285 raft_consensus.cc:359] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:48.961831  7284 raft_consensus.cc:740] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.972122  7285 raft_consensus.cc:385] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.964725  7496 consensus_queue.cc:1048] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.972759  7285 raft_consensus.cc:740] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.974794  7285 consensus_queue.cc:260] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:48.977427  7287 tablet_bootstrap.cc:492] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:48.974926  7450 raft_consensus.cc:2749] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.974455  7415 consensus_queue.cc:1048] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:26:48.982594  7285 ts_tablet_manager.cc:1434] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.056s	user 0.003s	sys 0.004s
W20260709 12:26:48.961839  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 59732.3us
I20260709 12:26:48.992901  7285 tablet_bootstrap.cc:492] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:48.997503  7288 raft_consensus.cc:359] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:48.998334  7288 raft_consensus.cc:385] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.000665  7288 raft_consensus.cc:740] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.006654  6912 catalog_manager.cc:5697] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.002717  7495 raft_consensus.cc:697] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:49.022464  7495 consensus_queue.cc:237] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:49.012620  7288 consensus_queue.cc:260] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:49.025206  7284 consensus_queue.cc:260] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:49.030103  7502 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:49.036650  7288 ts_tablet_manager.cc:1434] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.000s
I20260709 12:26:49.038123  7288 tablet_bootstrap.cc:492] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:49.069033  7284 ts_tablet_manager.cc:1434] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.134s	user 0.019s	sys 0.001s
I20260709 12:26:49.069185  7287 tablet_bootstrap.cc:654] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.062777  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:49.071194  7015 raft_consensus.cc:3060] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.072094  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:49.072839  7165 raft_consensus.cc:3060] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.076921  7288 tablet_bootstrap.cc:654] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.085376  7285 tablet_bootstrap.cc:654] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.088809  7284 tablet_bootstrap.cc:492] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:49.126360  7288 tablet_bootstrap.cc:492] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:49.113734  7493 consensus_queue.cc:1048] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:26:49.126901  7285 tablet_bootstrap.cc:492] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:49.126929  7288 ts_tablet_manager.cc:1403] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.089s	user 0.017s	sys 0.013s
I20260709 12:26:49.121709  6914 catalog_manager.cc:5697] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 0 to 2, leader changed from <none> to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 2 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.128365  7285 ts_tablet_manager.cc:1403] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.136s	user 0.004s	sys 0.013s
I20260709 12:26:49.131192  7284 tablet_bootstrap.cc:654] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.141855  7165 raft_consensus.cc:2468] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
W20260709 12:26:49.147506  7521 log.cc:927] Time spent T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:26:49.151507  7015 raft_consensus.cc:2468] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:26:49.162580  7055 leader_election.cc:304] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:49.163873  7500 raft_consensus.cc:2804] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:49.164381  7500 raft_consensus.cc:697] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:26:49.165256  7500 consensus_queue.cc:237] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:49.176187  7288 raft_consensus.cc:359] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:49.177274  7288 raft_consensus.cc:385] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.177623  7288 raft_consensus.cc:740] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.226720  7288 consensus_queue.cc:260] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:49.242515  7288 ts_tablet_manager.cc:1434] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.109s	user 0.006s	sys 0.001s
I20260709 12:26:49.244107  7285 raft_consensus.cc:359] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:49.246189  7285 raft_consensus.cc:385] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.246465  7285 raft_consensus.cc:740] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.247080  7285 consensus_queue.cc:260] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:49.248689  7288 tablet_bootstrap.cc:492] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:49.253368  7284 tablet_bootstrap.cc:492] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:49.253867  7284 ts_tablet_manager.cc:1403] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.165s	user 0.037s	sys 0.035s
I20260709 12:26:49.259302  7237 raft_consensus.cc:3060] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.261808  7285 ts_tablet_manager.cc:1434] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.133s	user 0.006s	sys 0.000s
I20260709 12:26:49.261610  7284 raft_consensus.cc:359] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:49.265038  7493 consensus_queue.cc:1048] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:49.266153  7285 tablet_bootstrap.cc:492] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:49.263437  7284 raft_consensus.cc:385] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.268025  7284 raft_consensus.cc:740] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.270579  7287 tablet_bootstrap.cc:492] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:49.269780  7284 consensus_queue.cc:260] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:49.271109  7287 ts_tablet_manager.cc:1403] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.295s	user 0.028s	sys 0.024s
I20260709 12:26:49.278998  7284 ts_tablet_manager.cc:1434] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 12:26:49.279338  7502 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.279660  7287 raft_consensus.cc:359] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:49.285909  7285 tablet_bootstrap.cc:654] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.288239  7287 raft_consensus.cc:385] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.303570  7287 raft_consensus.cc:740] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.289865  7284 tablet_bootstrap.cc:492] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:49.287990  7502 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:49.286651  7415 consensus_queue.cc:1048] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:26:49.307890  7502 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:49.309099  7287 consensus_queue.cc:260] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:49.313217  7288 tablet_bootstrap.cc:654] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.313383  7287 ts_tablet_manager.cc:1434] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.042s	user 0.010s	sys 0.000s
I20260709 12:26:49.325073  6913 catalog_manager.cc:5697] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66). New cstate: current_term: 1 leader_uuid: "9e6e5c8ad44447588681b10df7ad79ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.332285  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:49.333042  7164 raft_consensus.cc:2468] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 0.
I20260709 12:26:49.345614  7287 tablet_bootstrap.cc:492] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:49.363776  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:49.364530  7239 raft_consensus.cc:2468] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 0.
I20260709 12:26:49.365563  7360 consensus_queue.cc:1048] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:49.380378  7288 tablet_bootstrap.cc:492] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:49.380973  7288 ts_tablet_manager.cc:1403] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.138s	user 0.013s	sys 0.001s
I20260709 12:26:49.367313  7055 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:49.393262  7516 consensus_queue.cc:1048] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:49.399037  7492 raft_consensus.cc:2804] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:49.399282  7500 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.399904  7500 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:49.402140  7500 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:49.403860  7287 tablet_bootstrap.cc:654] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.399472  7492 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.404794  7492 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.383817  7288 raft_consensus.cc:359] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:49.417078  7288 raft_consensus.cc:385] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.417454  7288 raft_consensus.cc:740] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.410137  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:49.413003  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:49.439332  7288 consensus_queue.cc:260] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:49.447445  7285 tablet_bootstrap.cc:492] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:49.448109  7285 ts_tablet_manager.cc:1403] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.182s	user 0.011s	sys 0.020s
I20260709 12:26:49.451495  7288 ts_tablet_manager.cc:1434] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 12:26:49.452482  7288 tablet_bootstrap.cc:492] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:49.454401  7284 tablet_bootstrap.cc:654] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:49.457309  7055 leader_election.cc:343] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:49.460022  7533 log.cc:927] Time spent T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:26:49.478034  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:49.473810  7531 raft_consensus.cc:493] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:49.472883  7055 leader_election.cc:343] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.480921  7055 leader_election.cc:304] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:49.481742  7534 raft_consensus.cc:2749] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:49.480106  7531 raft_consensus.cc:515] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:49.485773  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:49.486912  7531 leader_election.cc:290] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:26:49.487769  7205 leader_election.cc:343] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.488967  7516 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.489442  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:49.490130  7016 raft_consensus.cc:2468] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:49.491642  7492 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:49.489467  7516 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:49.499295  7287 tablet_bootstrap.cc:492] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:49.499894  7287 ts_tablet_manager.cc:1403] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.166s	user 0.018s	sys 0.031s
I20260709 12:26:49.501180  7492 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:49.502928  7287 raft_consensus.cc:359] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:49.503701  7287 raft_consensus.cc:385] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.503997  7287 raft_consensus.cc:740] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.505358  7288 tablet_bootstrap.cc:654] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.505519  7202 leader_election.cc:304] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:49.504669  7287 consensus_queue.cc:260] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:49.506134  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:49.506776  7165 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.508025  7287 ts_tablet_manager.cc:1434] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:49.508774  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:49.509195  7287 tablet_bootstrap.cc:492] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:49.509429  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:49.510332  6980 leader_election.cc:343] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.516932  7287 tablet_bootstrap.cc:654] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.521090  7530 raft_consensus.cc:2804] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:49.521584  7530 raft_consensus.cc:493] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.522019  7530 raft_consensus.cc:3060] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.527078  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:49.527768  7236 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:49.527891  6982 leader_election.cc:343] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.528522  6982 leader_election.cc:304] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:49.529685  7516 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:49.535818  7285 raft_consensus.cc:359] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:49.533027  7088 raft_consensus.cc:1275] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:49.536495  7285 raft_consensus.cc:385] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.541530  7285 raft_consensus.cc:740] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.542290  7285 consensus_queue.cc:260] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:49.543325  7516 raft_consensus.cc:2749] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:49.543845  7285 ts_tablet_manager.cc:1434] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.095s	user 0.005s	sys 0.000s
I20260709 12:26:49.550671  7516 consensus_queue.cc:1048] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:49.540738  7530 raft_consensus.cc:515] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:49.530530  7165 raft_consensus.cc:2468] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:26:49.555591  7055 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:49.556504  7492 raft_consensus.cc:2804] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:49.557231  7492 raft_consensus.cc:697] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:26:49.557499  7530 leader_election.cc:290] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:49.562830  7285 tablet_bootstrap.cc:492] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:49.564996  7236 raft_consensus.cc:2468] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:26:49.565774  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:49.566471  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:49.567477  7013 raft_consensus.cc:3060] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.570429  7284 tablet_bootstrap.cc:492] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:49.570961  7284 ts_tablet_manager.cc:1403] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.282s	user 0.020s	sys 0.000s
I20260709 12:26:49.571744  7288 tablet_bootstrap.cc:492] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:49.572201  7288 ts_tablet_manager.cc:1403] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.120s	user 0.010s	sys 0.012s
W20260709 12:26:49.573665  7205 leader_election.cc:343] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.574847  7288 raft_consensus.cc:359] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:49.575562  7288 raft_consensus.cc:385] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.575819  7288 raft_consensus.cc:740] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.576318  7284 raft_consensus.cc:359] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:49.582206  7284 raft_consensus.cc:385] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.582597  7284 raft_consensus.cc:740] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.576592  7288 consensus_queue.cc:260] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:49.587994  7284 consensus_queue.cc:260] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:49.576635  7492 consensus_queue.cc:237] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:49.577962  7013 raft_consensus.cc:2468] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:49.604512  7202 leader_election.cc:304] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:49.605545  7530 raft_consensus.cc:2804] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:49.606004  7530 raft_consensus.cc:697] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:49.606361  7284 ts_tablet_manager.cc:1434] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:26:49.606813  7530 consensus_queue.cc:237] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:49.607380  7284 tablet_bootstrap.cc:492] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:49.607826  7288 ts_tablet_manager.cc:1434] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 12:26:49.620409  7534 consensus_queue.cc:1048] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:49.625586  7285 tablet_bootstrap.cc:654] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.627663  7288 tablet_bootstrap.cc:492] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:49.629423  7239 raft_consensus.cc:1275] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:49.635180  7284 tablet_bootstrap.cc:654] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.637835  7495 consensus_queue.cc:1048] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:49.651723  7288 tablet_bootstrap.cc:654] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.655758  7287 tablet_bootstrap.cc:492] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:49.656415  7287 ts_tablet_manager.cc:1403] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.147s	user 0.018s	sys 0.022s
I20260709 12:26:49.675489  7287 raft_consensus.cc:359] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:49.676234  7287 raft_consensus.cc:385] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.678325  7502 consensus_queue.cc:1048] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:49.690085  6910 catalog_manager.cc:5697] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66). New cstate: current_term: 1 leader_uuid: "9e6e5c8ad44447588681b10df7ad79ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.676499  7287 raft_consensus.cc:740] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.707006  6912 catalog_manager.cc:5697] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 1 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.709096  7287 consensus_queue.cc:260] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:49.728767  7287 ts_tablet_manager.cc:1434] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 12:26:49.738639  7287 tablet_bootstrap.cc:492] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:49.738782  7284 tablet_bootstrap.cc:492] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:49.739473  7284 ts_tablet_manager.cc:1403] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.132s	user 0.009s	sys 0.003s
I20260709 12:26:49.743330  7284 raft_consensus.cc:359] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:49.744086  7495 raft_consensus.cc:493] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.744202  7284 raft_consensus.cc:385] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.744755  7495 raft_consensus.cc:515] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:49.744776  7284 raft_consensus.cc:740] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.746353  7284 consensus_queue.cc:260] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:49.749063  7285 tablet_bootstrap.cc:492] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:49.749271  7284 ts_tablet_manager.cc:1434] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:26:49.749600  7285 ts_tablet_manager.cc:1403] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.197s	user 0.014s	sys 0.007s
I20260709 12:26:49.750771  7284 tablet_bootstrap.cc:492] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:49.756124  7495 leader_election.cc:290] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:49.757266  7284 tablet_bootstrap.cc:654] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.758008  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:49.758376  7530 raft_consensus.cc:493] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.758913  7530 raft_consensus.cc:515] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:49.761484  7288 tablet_bootstrap.cc:492] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:49.761996  7288 ts_tablet_manager.cc:1403] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.137s	user 0.013s	sys 0.002s
I20260709 12:26:49.762171  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:49.752166  7285 raft_consensus.cc:359] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:49.763942  7285 raft_consensus.cc:385] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.764267  7285 raft_consensus.cc:740] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.765857  7285 consensus_queue.cc:260] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:49.766953  7288 raft_consensus.cc:359] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:49.767652  7288 raft_consensus.cc:385] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.767874  7288 raft_consensus.cc:740] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.768428  7288 consensus_queue.cc:260] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:26:49.766430  7205 leader_election.cc:343] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.771697  7288 ts_tablet_manager.cc:1434] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:49.773584  7285 ts_tablet_manager.cc:1434] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:26:49.771494  7164 raft_consensus.cc:2468] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:26:49.790907  6980 leader_election.cc:304] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:49.791762  7495 raft_consensus.cc:2804] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:49.792233  7495 raft_consensus.cc:493] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.792599  7495 raft_consensus.cc:3060] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.774874  7530 leader_election.cc:290] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:49.772074  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:49.778221  7288 tablet_bootstrap.cc:492] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:49.779136  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:26:49.799688  6982 leader_election.cc:343] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:49.802131  7203 leader_election.cc:343] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.802686  7203 leader_election.cc:304] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:49.805169  7493 raft_consensus.cc:2749] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:49.805806  7288 tablet_bootstrap.cc:654] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.806067  7495 raft_consensus.cc:515] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:49.777691  7285 tablet_bootstrap.cc:492] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:49.808893  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:49.810117  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:49.810729  7165 raft_consensus.cc:3060] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:49.810874  6982 leader_election.cc:343] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.781519  7287 tablet_bootstrap.cc:654] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.818493  7165 raft_consensus.cc:2468] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:49.819713  6980 leader_election.cc:304] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:49.820218  7285 tablet_bootstrap.cc:654] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.820708  7360 raft_consensus.cc:2804] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:49.821261  7360 raft_consensus.cc:697] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:49.822068  7360 consensus_queue.cc:237] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:49.834280  7515 raft_consensus.cc:493] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.834793  7515 raft_consensus.cc:515] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:49.840070  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:49.841241  7239 raft_consensus.cc:2468] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:26:49.842568  6980 leader_election.cc:304] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:49.842782  7515 leader_election.cc:290] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:49.843492  7515 raft_consensus.cc:2804] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:49.843883  7515 raft_consensus.cc:493] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.844250  7515 raft_consensus.cc:3060] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.850533  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:49.828236  7495 leader_election.cc:290] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:26:49.859143  6982 leader_election.cc:343] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.863399  7284 tablet_bootstrap.cc:492] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:49.863749  7288 tablet_bootstrap.cc:492] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:49.863984  7284 ts_tablet_manager.cc:1403] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.113s	user 0.026s	sys 0.020s
I20260709 12:26:49.864234  7288 ts_tablet_manager.cc:1403] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.086s	user 0.009s	sys 0.005s
I20260709 12:26:49.864745  6910 catalog_manager.cc:5697] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.868042  7287 tablet_bootstrap.cc:492] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:49.868518  7287 ts_tablet_manager.cc:1403] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.130s	user 0.011s	sys 0.004s
I20260709 12:26:49.868453  7288 raft_consensus.cc:359] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:49.869374  7288 raft_consensus.cc:385] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.869714  7288 raft_consensus.cc:740] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.870324  7515 raft_consensus.cc:515] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:49.867558  7284 raft_consensus.cc:359] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:49.871280  7284 raft_consensus.cc:385] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.871603  7284 raft_consensus.cc:740] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.871690  7287 raft_consensus.cc:359] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:49.872864  7287 raft_consensus.cc:385] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.872368  7284 consensus_queue.cc:260] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:49.873207  7287 raft_consensus.cc:740] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.873908  7287 consensus_queue.cc:260] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:49.875837  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:49.876144  7287 ts_tablet_manager.cc:1434] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:26:49.876497  7239 raft_consensus.cc:3060] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.877235  7287 tablet_bootstrap.cc:492] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:49.878597  7284 ts_tablet_manager.cc:1434] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 12:26:49.878466  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:49.879000  7515 leader_election.cc:290] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:26:49.880067  6982 leader_election.cc:343] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.880818  7285 tablet_bootstrap.cc:492] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:49.886969  7285 ts_tablet_manager.cc:1403] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.109s	user 0.014s	sys 0.013s
I20260709 12:26:49.890367  7285 raft_consensus.cc:359] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:49.891029  7285 raft_consensus.cc:385] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.891283  7285 raft_consensus.cc:740] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.881259  7284 tablet_bootstrap.cc:492] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:49.891897  7285 consensus_queue.cc:260] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:49.892782  7288 consensus_queue.cc:260] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:49.893659  7530 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.894071  7285 ts_tablet_manager.cc:1434] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:49.894155  7530 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:49.895125  7285 tablet_bootstrap.cc:492] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:49.898775  7530 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:49.892107  7239 raft_consensus.cc:2468] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:49.900004  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:49.901767  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:26:49.903440  7203 leader_election.cc:343] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.904057  7495 raft_consensus.cc:493] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.904538  7495 raft_consensus.cc:515] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:26:49.904986  7202 leader_election.cc:343] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.905504  7202 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:49.906327  7530 raft_consensus.cc:2749] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:49.906608  7495 leader_election.cc:290] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:49.907174  7288 ts_tablet_manager.cc:1434] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 12:26:49.908298  7288 tablet_bootstrap.cc:492] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:49.910771  6980 leader_election.cc:304] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:49.911325  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:26:49.912704  6980 leader_election.cc:343] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.912731  7360 raft_consensus.cc:2804] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:49.913661  7285 tablet_bootstrap.cc:654] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.913782  7360 raft_consensus.cc:697] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:49.914988  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:49.914799  7360 consensus_queue.cc:237] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:26:49.917050  6980 leader_election.cc:343] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.917490  6980 leader_election.cc:304] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:49.920473  7387 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.921226  7284 tablet_bootstrap.cc:654] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.921057  7387 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:49.924428  7387 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:49.924511  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:49.925150  7534 raft_consensus.cc:493] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.925459  7088 raft_consensus.cc:2468] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:49.925807  7534 raft_consensus.cc:515] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:49.927026  7131 leader_election.cc:304] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:49.928177  7534 leader_election.cc:290] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:49.929355  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:49.930091  7015 raft_consensus.cc:2468] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:49.932545  7530 raft_consensus.cc:493] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.933172  7387 raft_consensus.cc:2804] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:49.933090  7530 raft_consensus.cc:515] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:49.933624  7387 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.934005  7387 raft_consensus.cc:3060] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.934818  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:49.935712  7015 raft_consensus.cc:2393] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 1: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:26:49.936650  7517 raft_consensus.cc:2749] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:49.941491  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:49.943608  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:49.944435  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:49.945974  7285 tablet_bootstrap.cc:492] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:49.945667  7530 leader_election.cc:290] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:49.945207  7015 raft_consensus.cc:2468] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
W20260709 12:26:49.945411  7203 leader_election.cc:343] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.948104  7285 ts_tablet_manager.cc:1403] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.001s
I20260709 12:26:49.948982  7055 leader_election.cc:304] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:49.949401  7202 leader_election.cc:304] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:26:49.950265  7534 raft_consensus.cc:3060] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.950763  7530 raft_consensus.cc:2804] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:49.951294  7530 raft_consensus.cc:493] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.951723  7530 raft_consensus.cc:3060] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.883795  7287 tablet_bootstrap.cc:654] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.954392  7285 raft_consensus.cc:359] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:49.955066  7285 raft_consensus.cc:385] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.955340  7285 raft_consensus.cc:740] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.955899  7387 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:49.956100  7285 consensus_queue.cc:260] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:49.958195  7288 tablet_bootstrap.cc:654] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.959067  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:49.959223  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:49.959899  7088 raft_consensus.cc:3060] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.960151  7015 raft_consensus.cc:3060] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.961385  7534 raft_consensus.cc:2749] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:49.959884  7387 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:26:50.033291  7559 log.cc:927] Time spent T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:26:50.037715  7088 raft_consensus.cc:2468] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:50.040310  7131 leader_election.cc:304] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:50.043198  7387 raft_consensus.cc:2804] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.043872  7015 raft_consensus.cc:2468] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:50.044065  7387 raft_consensus.cc:697] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:50.045228  7387 consensus_queue.cc:237] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:50.041930  7285 ts_tablet_manager.cc:1434] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.093s	user 0.005s	sys 0.007s
I20260709 12:26:50.052037  7285 tablet_bootstrap.cc:492] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:50.061506  7530 raft_consensus.cc:515] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:50.064009  7530 leader_election.cc:290] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:50.067540  7505 raft_consensus.cc:493] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.068179  7505 raft_consensus.cc:515] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:50.070370  6910 catalog_manager.cc:5697] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:50.072476  7505 leader_election.cc:290] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:50.074544  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:50.075496  7013 raft_consensus.cc:3060] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.064419  7285 tablet_bootstrap.cc:654] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.116496  7284 tablet_bootstrap.cc:492] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:50.117085  7284 ts_tablet_manager.cc:1403] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.236s	user 0.012s	sys 0.010s
I20260709 12:26:50.133163  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:50.133965  7165 raft_consensus.cc:3060] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.136966  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:50.139370  7534 consensus_queue.cc:1048] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.147112  7013 raft_consensus.cc:2468] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:50.151489  7165 raft_consensus.cc:2468] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:50.162678  7202 leader_election.cc:304] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:50.163904  7531 raft_consensus.cc:2804] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.164427  7531 raft_consensus.cc:697] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:50.165377  7531 consensus_queue.cc:237] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:50.170418  7284 raft_consensus.cc:359] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:50.171360  7284 raft_consensus.cc:385] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.171722  7284 raft_consensus.cc:740] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.174495  7284 consensus_queue.cc:260] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:50.183303  7284 ts_tablet_manager.cc:1434] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 12:26:50.200139  7284 tablet_bootstrap.cc:492] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:50.203267  7287 tablet_bootstrap.cc:492] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:50.203969  7287 ts_tablet_manager.cc:1403] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.327s	user 0.032s	sys 0.020s
I20260709 12:26:50.212540  7288 tablet_bootstrap.cc:492] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:50.213181  7288 ts_tablet_manager.cc:1403] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.305s	user 0.010s	sys 0.009s
I20260709 12:26:50.213766  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:50.215924  7288 raft_consensus.cc:359] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.216473  7566 raft_consensus.cc:493] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.216727  7288 raft_consensus.cc:385] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.217021  7566 raft_consensus.cc:515] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:50.219157  7566 leader_election.cc:290] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:50.217020  7288 raft_consensus.cc:740] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.220464  7288 consensus_queue.cc:260] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.222766  7288 ts_tablet_manager.cc:1434] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:50.223003  7129 leader_election.cc:304] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:50.223748  7288 tablet_bootstrap.cc:492] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:50.224931  7564 raft_consensus.cc:2749] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:50.225379  7531 consensus_queue.cc:1048] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.229053  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:50.238095  7502 consensus_queue.cc:1048] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:50.243278  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:50.243943  7016 raft_consensus.cc:2468] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:50.243289  7288 tablet_bootstrap.cc:654] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.237453  6912 catalog_manager.cc:5697] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 1 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:50.251024  7531 consensus_queue.cc:1048] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:50.253286  7285 tablet_bootstrap.cc:492] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:50.256529  7285 ts_tablet_manager.cc:1403] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.205s	user 0.025s	sys 0.023s
W20260709 12:26:50.232781  7129 leader_election.cc:343] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.262672  7128 leader_election.cc:304] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:50.234890  7287 raft_consensus.cc:359] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:50.265066  7287 raft_consensus.cc:385] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.265877  7284 tablet_bootstrap.cc:654] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.266250  7287 raft_consensus.cc:740] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.270735  7287 consensus_queue.cc:260] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:50.271524  7285 raft_consensus.cc:359] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.272325  7285 raft_consensus.cc:385] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.272625  7285 raft_consensus.cc:740] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.264665  7566 raft_consensus.cc:2804] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.273298  7285 consensus_queue.cc:260] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.274713  7566 raft_consensus.cc:493] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.275157  7566 raft_consensus.cc:3060] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.286603  7285 ts_tablet_manager.cc:1434] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.004s
I20260709 12:26:50.290083  7287 ts_tablet_manager.cc:1434] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.003s
I20260709 12:26:50.290701  7502 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.293376  7502 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.296093  7502 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:50.296818  7285 tablet_bootstrap.cc:492] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:50.300725  7287 tablet_bootstrap.cc:492] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:50.297578  7534 raft_consensus.cc:493] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.305207  7534 raft_consensus.cc:515] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:50.305879  7288 tablet_bootstrap.cc:492] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:50.306351  7288 ts_tablet_manager.cc:1403] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.007s
I20260709 12:26:50.307313  7534 leader_election.cc:290] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:50.309487  7287 tablet_bootstrap.cc:654] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.311512  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:50.313206  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:26:50.314083  6982 consensus_peers.cc:597] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 -> Peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Couldn't send request to peer 9e6e5c8ad44447588681b10df7ad79ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:50.314661  7493 raft_consensus.cc:493] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.315213  7493 raft_consensus.cc:515] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:26:50.315738  7054 leader_election.cc:343] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.317557  7493 leader_election.cc:290] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:50.319867  7566 raft_consensus.cc:515] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:50.321450  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:50.322193  7237 raft_consensus.cc:2468] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 0.
I20260709 12:26:50.323176  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:50.323364  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:50.323853  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:50.323791  7015 raft_consensus.cc:3060] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.324632  7163 raft_consensus.cc:2468] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 0.
W20260709 12:26:50.325254  7055 leader_election.cc:343] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.325742  7055 leader_election.cc:304] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
W20260709 12:26:50.325986  7129 leader_election.cc:343] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.327977  7502 raft_consensus.cc:2749] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:50.309103  7288 raft_consensus.cc:359] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:50.331501  7288 raft_consensus.cc:385] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.331749  7055 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:50.331992  7288 raft_consensus.cc:740] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.322031  7566 leader_election.cc:290] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:50.336252  7288 consensus_queue.cc:260] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:50.336964  7502 raft_consensus.cc:2804] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.337373  7517 consensus_queue.cc:1048] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.338639  7288 ts_tablet_manager.cc:1434] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:26:50.337385  7502 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.339287  7502 raft_consensus.cc:3060] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.339608  7288 tablet_bootstrap.cc:492] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:50.341091  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:50.323783  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:26:50.343313  7568 log.cc:927] Time spent T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:26:50.353008  7288 tablet_bootstrap.cc:654] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:50.353773  7203 leader_election.cc:343] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.354003  7502 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.363101  6912 catalog_manager.cc:5697] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 1 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:50.376919  7205 leader_election.cc:343] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.377410  7502 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:50.390201  7285 tablet_bootstrap.cc:654] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.395292  7205 leader_election.cc:304] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:50.409268  7493 raft_consensus.cc:2749] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:50.412146  7284 tablet_bootstrap.cc:492] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:50.412868  7284 ts_tablet_manager.cc:1403] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.215s	user 0.009s	sys 0.008s
I20260709 12:26:50.419480  7284 raft_consensus.cc:359] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.420197  7284 raft_consensus.cc:385] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.424384  7015 raft_consensus.cc:2468] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:50.426525  7128 leader_election.cc:304] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:50.428161  7566 raft_consensus.cc:2804] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.428795  7566 raft_consensus.cc:697] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:50.429828  7566 consensus_queue.cc:237] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:50.420480  7284 raft_consensus.cc:740] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.432796  7284 consensus_queue.cc:260] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.436088  7284 ts_tablet_manager.cc:1434] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:26:50.437141  7284 tablet_bootstrap.cc:492] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:50.441236  7288 tablet_bootstrap.cc:492] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:50.449510  7288 ts_tablet_manager.cc:1403] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.004s
I20260709 12:26:50.453541  7387 consensus_queue.cc:1048] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.454663  7287 tablet_bootstrap.cc:492] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:50.455175  7287 ts_tablet_manager.cc:1403] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.155s	user 0.024s	sys 0.028s
I20260709 12:26:50.463433  7287 raft_consensus.cc:359] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:50.465162  7285 tablet_bootstrap.cc:492] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:50.465677  7285 ts_tablet_manager.cc:1403] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.176s	user 0.011s	sys 0.004s
I20260709 12:26:50.465755  7288 raft_consensus.cc:359] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:50.466476  7288 raft_consensus.cc:385] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.466745  7288 raft_consensus.cc:740] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.467353  7288 consensus_queue.cc:260] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:50.468250  7285 raft_consensus.cc:359] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.469134  7285 raft_consensus.cc:385] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.469398  7285 raft_consensus.cc:740] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.469988  7287 raft_consensus.cc:385] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.471767  7287 raft_consensus.cc:740] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.472517  7287 consensus_queue.cc:260] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:50.474498  7287 ts_tablet_manager.cc:1434] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:26:50.475538  7287 tablet_bootstrap.cc:492] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:50.470151  7285 consensus_queue.cc:260] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.478188  7566 consensus_queue.cc:1048] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.478958  7285 ts_tablet_manager.cc:1434] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:26:50.479974  7285 tablet_bootstrap.cc:492] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:50.481460  7288 ts_tablet_manager.cc:1434] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 12:26:50.482419  7288 tablet_bootstrap.cc:492] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:50.490314  6913 catalog_manager.cc:5697] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 1 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:50.493058  6982 consensus_peers.cc:597] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 -> Peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Couldn't send request to peer 9e6e5c8ad44447588681b10df7ad79ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:50.495453  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 146146us
I20260709 12:26:50.497572  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:50.498183  7163 raft_consensus.cc:3060] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.506285  7163 raft_consensus.cc:2468] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:26:50.448583  7517 consensus_queue.cc:1048] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.507480  7288 tablet_bootstrap.cc:654] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.507736  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:50.510401  7239 raft_consensus.cc:3060] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.520501  7287 tablet_bootstrap.cc:654] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.521579  7239 raft_consensus.cc:2468] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:26:50.446725  7284 tablet_bootstrap.cc:654] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.529486  7055 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:50.530388  7492 raft_consensus.cc:2804] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.530871  7492 raft_consensus.cc:697] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:26:50.531719  7492 consensus_queue.cc:237] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.536091  7285 tablet_bootstrap.cc:654] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.549798  7517 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.550387  7517 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:50.552541  7517 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:50.554391  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:26:50.556686  6980 leader_election.cc:343] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.560863  7288 tablet_bootstrap.cc:492] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:50.561367  7288 ts_tablet_manager.cc:1403] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.079s	user 0.007s	sys 0.008s
I20260709 12:26:50.554766  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:50.562949  7236 raft_consensus.cc:2468] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:26:50.564230  6980 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:26:50.564316  7288 raft_consensus.cc:359] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:50.565128  7495 raft_consensus.cc:2804] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.565356  7288 raft_consensus.cc:385] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.565541  7495 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.565804  7288 raft_consensus.cc:740] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.565968  7495 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.568609  7564 raft_consensus.cc:493] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.569135  7564 raft_consensus.cc:515] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.571271  7564 leader_election.cc:290] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:50.572821  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:50.573482  7089 raft_consensus.cc:2468] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:50.573901  7495 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:50.574906  7131 leader_election.cc:304] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:50.576510  7505 raft_consensus.cc:2804] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.576912  7505 raft_consensus.cc:493] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.577219  7505 raft_consensus.cc:3060] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.577127  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:50.579532  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:50.580430  7236 raft_consensus.cc:2468] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
W20260709 12:26:50.581234  6980 leader_election.cc:343] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.585654  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:50.586555  7236 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.587111  7493 consensus_queue.cc:1048] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.594569  7495 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:50.595193  7284 tablet_bootstrap.cc:492] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:50.600335  7284 ts_tablet_manager.cc:1403] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.163s	user 0.010s	sys 0.002s
I20260709 12:26:50.601076  7288 consensus_queue.cc:260] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:50.603670  7288 ts_tablet_manager.cc:1434] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 12:26:50.599650  7287 tablet_bootstrap.cc:492] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:50.605346  7287 ts_tablet_manager.cc:1403] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.130s	user 0.013s	sys 0.001s
I20260709 12:26:50.609409  7287 raft_consensus.cc:359] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:50.603309  7284 raft_consensus.cc:359] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:50.604813  7288 tablet_bootstrap.cc:492] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:50.610324  7287 raft_consensus.cc:385] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.598407  7236 raft_consensus.cc:2468] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:50.620076  7287 raft_consensus.cc:740] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.610471  7284 raft_consensus.cc:385] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.621587  7284 raft_consensus.cc:740] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.622013  6980 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:26:50.622463  7284 consensus_queue.cc:260] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:50.624760  7284 ts_tablet_manager.cc:1434] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.004s
I20260709 12:26:50.625038  7287 consensus_queue.cc:260] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:50.613492  7505 raft_consensus.cc:515] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.614395  7285 tablet_bootstrap.cc:492] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:50.626340  7285 ts_tablet_manager.cc:1403] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.147s	user 0.026s	sys 0.014s
I20260709 12:26:50.625842  7284 tablet_bootstrap.cc:492] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:50.628777  7530 consensus_queue.cc:1048] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.629024  7285 raft_consensus.cc:359] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.629702  7285 raft_consensus.cc:385] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.629976  7285 raft_consensus.cc:740] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.630743  7360 raft_consensus.cc:2804] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.631279  7360 raft_consensus.cc:697] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:50.633944  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:50.634544  7089 raft_consensus.cc:3060] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.632144  7360 consensus_queue.cc:237] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:50.641359  7287 ts_tablet_manager.cc:1434] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 12:26:50.642702  7287 tablet_bootstrap.cc:492] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:50.643187  7285 consensus_queue.cc:260] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.646028  7089 raft_consensus.cc:2468] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:50.647423  7131 leader_election.cc:304] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:50.648023  7285 ts_tablet_manager.cc:1434] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:26:50.648476  7564 raft_consensus.cc:2804] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.651504  7564 raft_consensus.cc:697] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:50.652057  7285 tablet_bootstrap.cc:492] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:50.652494  7564 consensus_queue.cc:237] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.655454  7287 tablet_bootstrap.cc:654] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.657071  6913 catalog_manager.cc:5697] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66). New cstate: current_term: 1 leader_uuid: "9e6e5c8ad44447588681b10df7ad79ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:50.658123  7505 leader_election.cc:290] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:50.659363  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:50.659998  7236 raft_consensus.cc:3060] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.671918  7288 tablet_bootstrap.cc:654] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:50.675578  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:50.679989  6910 catalog_manager.cc:5697] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:50.682119  7566 raft_consensus.cc:493] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.676406  7284 tablet_bootstrap.cc:654] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.693210  7285 tablet_bootstrap.cc:654] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.684333  7236 raft_consensus.cc:2468] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:50.688512  7566 raft_consensus.cc:515] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.710314  7566 leader_election.cc:290] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:50.711192  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:50.711421  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:50.712050  7236 raft_consensus.cc:2468] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
W20260709 12:26:50.713033  7131 leader_election.cc:343] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.713966  7129 leader_election.cc:304] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:50.715637  7288 tablet_bootstrap.cc:492] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:50.716140  7288 ts_tablet_manager.cc:1403] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.112s	user 0.008s	sys 0.005s
I20260709 12:26:50.718808  7288 raft_consensus.cc:359] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:50.719483  7288 raft_consensus.cc:385] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.719514  7566 raft_consensus.cc:2804] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.719851  7288 raft_consensus.cc:740] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.720072  7566 raft_consensus.cc:493] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.720566  7566 raft_consensus.cc:3060] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.721223  7288 consensus_queue.cc:260] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:50.722421  7285 tablet_bootstrap.cc:492] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:50.723001  7285 ts_tablet_manager.cc:1403] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.001s
I20260709 12:26:50.726030  7285 raft_consensus.cc:359] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:50.726665  7285 raft_consensus.cc:385] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.727162  7285 raft_consensus.cc:740] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.727895  7288 ts_tablet_manager.cc:1434] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:26:50.727883  7285 consensus_queue.cc:260] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:50.729230  7288 tablet_bootstrap.cc:492] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:50.729808  7566 raft_consensus.cc:515] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.748926  7285 ts_tablet_manager.cc:1434] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:26:50.750001  7285 tablet_bootstrap.cc:492] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:50.733319  7287 tablet_bootstrap.cc:492] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:50.751623  7287 ts_tablet_manager.cc:1403] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.109s	user 0.011s	sys 0.010s
I20260709 12:26:50.754025  7288 tablet_bootstrap.cc:654] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.755934  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:50.756146  7566 leader_election.cc:290] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:26:50.757498  7131 leader_election.cc:343] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.757712  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:50.758334  7236 raft_consensus.cc:3060] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.758549  6913 catalog_manager.cc:5697] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 1 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:50.761534  7287 raft_consensus.cc:359] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:50.762234  7287 raft_consensus.cc:385] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.762498  7287 raft_consensus.cc:740] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.764128  7236 raft_consensus.cc:2468] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:50.764925  7284 tablet_bootstrap.cc:492] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:50.765369  7284 ts_tablet_manager.cc:1403] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.140s	user 0.012s	sys 0.005s
I20260709 12:26:50.765831  7129 leader_election.cc:304] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:50.767590  7566 raft_consensus.cc:2804] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.767845  7288 tablet_bootstrap.cc:492] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:50.768184  7566 raft_consensus.cc:697] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:50.769143  7566 consensus_queue.cc:237] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.768833  7284 raft_consensus.cc:359] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:50.768316  7288 ts_tablet_manager.cc:1403] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.004s
I20260709 12:26:50.771028  7287 consensus_queue.cc:260] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:50.771458  7284 raft_consensus.cc:385] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.771857  7284 raft_consensus.cc:740] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.772864  7284 consensus_queue.cc:260] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:50.773269  7287 ts_tablet_manager.cc:1434] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:26:50.774374  7530 raft_consensus.cc:493] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.774276  7288 raft_consensus.cc:359] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.774950  7288 raft_consensus.cc:385] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.774900  7530 raft_consensus.cc:515] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:50.775332  7288 raft_consensus.cc:740] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.774993  7284 ts_tablet_manager.cc:1434] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:26:50.776944  7288 consensus_queue.cc:260] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.777590  7284 tablet_bootstrap.cc:492] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:50.780522  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:50.782186  7205 leader_election.cc:343] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.779160  7288 ts_tablet_manager.cc:1434] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:50.777274  7530 leader_election.cc:290] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:50.784088  7288 tablet_bootstrap.cc:492] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:50.785708  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:50.786402  7016 raft_consensus.cc:2468] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:50.787832  7202 leader_election.cc:304] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:50.789413  7287 tablet_bootstrap.cc:492] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:50.790654  7530 raft_consensus.cc:2804] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.792047  7530 raft_consensus.cc:493] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.792505  7530 raft_consensus.cc:3060] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.795900  7495 raft_consensus.cc:493] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.796609  7495 raft_consensus.cc:515] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:50.798839  7495 leader_election.cc:290] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:50.799335  7288 tablet_bootstrap.cc:654] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.800545  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:50.800927  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:50.801262  7088 raft_consensus.cc:2468] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:26:50.802809  6982 leader_election.cc:304] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:50.803194  7530 raft_consensus.cc:515] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:26:50.803694  6980 leader_election.cc:343] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.804052  7495 raft_consensus.cc:2804] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.804577  7495 raft_consensus.cc:493] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.805078  7495 raft_consensus.cc:3060] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.812175  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:26:50.813820  7205 leader_election.cc:343] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.815322  7530 leader_election.cc:290] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:50.815335  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:50.816305  7016 raft_consensus.cc:3060] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.819164  7285 tablet_bootstrap.cc:654] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.819752  7287 tablet_bootstrap.cc:654] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.831945  7493 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.832731  7493 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:50.836759  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:50.837631  7091 raft_consensus.cc:2468] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:50.839089  7493 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:50.840027  7205 leader_election.cc:304] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:50.841426  7493 raft_consensus.cc:2804] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.841874  7493 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.841650  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:26:50.843748  7202 leader_election.cc:343] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.846606  7493 raft_consensus.cc:3060] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.850841  7016 raft_consensus.cc:2468] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:50.856097  7202 leader_election.cc:304] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:50.857868  7530 raft_consensus.cc:2804] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.858517  7530 raft_consensus.cc:697] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:50.859557  7530 consensus_queue.cc:237] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:50.869753  7284 tablet_bootstrap.cc:654] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.875591  7492 raft_consensus.cc:493] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.876330  7492 raft_consensus.cc:515] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:50.883414  7493 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:50.884444  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:50.885879  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:50.887578  7055 leader_election.cc:304] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:50.887652  7492 leader_election.cc:290] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:50.888378  7580 raft_consensus.cc:2749] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:50.890748  7566 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.854568  7495 raft_consensus.cc:515] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:50.891270  7566 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:50.893435  7495 leader_election.cc:290] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:50.893465  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:50.894182  7091 raft_consensus.cc:3060] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.894361  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
W20260709 12:26:50.895856  6980 leader_election.cc:343] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.898435  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:50.903083  7016 raft_consensus.cc:2468] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:50.906020  7566 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:50.907780  7128 leader_election.cc:304] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:50.909094  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:50.910054  7091 raft_consensus.cc:2468] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
W20260709 12:26:50.910665  7131 leader_election.cc:343] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.919389  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:50.904997  7528 raft_consensus.cc:493] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.897218  6914 catalog_manager.cc:5697] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 1 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:50.920087  7528 raft_consensus.cc:515] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:26:50.920928  7202 leader_election.cc:343] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.922335  7528 leader_election.cc:290] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:50.923280  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:50.923828  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:50.923823  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:50.924536  7088 raft_consensus.cc:3060] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.923943  7016 raft_consensus.cc:2468] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:50.926141  7202 leader_election.cc:304] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:50.927809  7530 raft_consensus.cc:2804] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.928170  7530 raft_consensus.cc:493] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.928501  7530 raft_consensus.cc:3060] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:50.930049  7203 leader_election.cc:343] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.930595  7284 tablet_bootstrap.cc:492] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:50.909394  7285 tablet_bootstrap.cc:492] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:50.931054  7284 ts_tablet_manager.cc:1403] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.154s	user 0.011s	sys 0.001s
I20260709 12:26:50.931383  7285 ts_tablet_manager.cc:1403] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.182s	user 0.009s	sys 0.002s
I20260709 12:26:50.913666  6910 catalog_manager.cc:5697] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 1 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:50.933740  7284 raft_consensus.cc:359] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:50.934381  7284 raft_consensus.cc:385] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.914474  7288 tablet_bootstrap.cc:492] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:50.934990  7288 ts_tablet_manager.cc:1403] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.151s	user 0.008s	sys 0.036s
I20260709 12:26:50.934916  7530 raft_consensus.cc:515] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:50.938087  7288 raft_consensus.cc:359] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:50.938673  7530 leader_election.cc:290] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:50.917553  7566 raft_consensus.cc:2804] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.940471  7566 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.919682  7287 tablet_bootstrap.cc:492] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:50.940587  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:50.940908  7566 raft_consensus.cc:3060] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.941234  7287 ts_tablet_manager.cc:1403] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.152s	user 0.026s	sys 0.071s
I20260709 12:26:50.941642  7284 raft_consensus.cc:740] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.942581  7284 consensus_queue.cc:260] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:50.943395  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:50.943976  7015 raft_consensus.cc:3060] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.938767  7288 raft_consensus.cc:385] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.947939  7288 raft_consensus.cc:740] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.948282  7284 ts_tablet_manager.cc:1434] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:26:50.948802  7288 consensus_queue.cc:260] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:50.949379  7284 tablet_bootstrap.cc:492] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
W20260709 12:26:50.958186  7203 leader_election.cc:343] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.958799  7239 raft_consensus.cc:3060] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.960585  7505 consensus_queue.cc:1048] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.963326  7285 raft_consensus.cc:359] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.964020  7284 tablet_bootstrap.cc:654] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.964578  7288 ts_tablet_manager.cc:1434] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 12:26:50.964062  7285 raft_consensus.cc:385] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.964978  7285 raft_consensus.cc:740] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.965705  7088 raft_consensus.cc:2468] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:50.966897  7205 leader_election.cc:304] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:50.967710  7531 raft_consensus.cc:2804] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.968160  7531 raft_consensus.cc:697] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:50.968961  7531 consensus_queue.cc:237] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:50.944195  7287 raft_consensus.cc:359] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:50.970048  7287 raft_consensus.cc:385] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.970376  7287 raft_consensus.cc:740] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.971046  7287 consensus_queue.cc:260] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:50.971266  7285 consensus_queue.cc:260] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:50.972867  7288 tablet_bootstrap.cc:492] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:50.977029  7505 consensus_queue.cc:1048] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:50.978461  6982 leader_election.cc:304] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:26:50.958763  7015 raft_consensus.cc:2468] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:50.918846  7493 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:50.982695  7495 raft_consensus.cc:2804] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.984297  7287 ts_tablet_manager.cc:1434] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.003s
I20260709 12:26:50.988190  7528 raft_consensus.cc:493] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.995426  7566 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:51.001014  7285 ts_tablet_manager.cc:1434] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.069s	user 0.005s	sys 0.001s
I20260709 12:26:51.142292  7288 tablet_bootstrap.cc:700] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent opening tablet: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:26:51.187388  7288 tablet_bootstrap.cc:654] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.192072  7287 tablet_bootstrap.cc:492] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:51.262992  7285 tablet_bootstrap.cc:492] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:51.177627  7495 raft_consensus.cc:697] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:51.186094  7528 raft_consensus.cc:515] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:51.298377  7528 leader_election.cc:290] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:51.286873  7492 raft_consensus.cc:493] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.370141  7492 raft_consensus.cc:515] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:51.642235  7566 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:51.403157  7495 consensus_queue.cc:237] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:51.680248  7492 leader_election.cc:290] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:51.685797  7284 tablet_bootstrap.cc:492] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:51.686550  7284 ts_tablet_manager.cc:1403] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.737s	user 0.030s	sys 0.065s
I20260709 12:26:51.674369  7612 raft_consensus.cc:493] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.696427  7284 raft_consensus.cc:359] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:51.700482  7284 raft_consensus.cc:385] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:51.700966  7284 raft_consensus.cc:740] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:51.702142  7284 consensus_queue.cc:260] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:51.715854  7284 ts_tablet_manager.cc:1434] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 12:26:51.726907  7284 tablet_bootstrap.cc:492] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
W20260709 12:26:51.727161  7610 log.cc:927] Time spent T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:26:51.755527  7285 tablet_bootstrap.cc:654] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.700680  7612 raft_consensus.cc:515] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:26:51.829092  7611 log.cc:927] Time spent T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:26:51.834631  7287 tablet_bootstrap.cc:654] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:51.838457  7612 leader_election.cc:290] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:51.943331  7284 tablet_bootstrap.cc:654] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.052464  7285 tablet_bootstrap.cc:492] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:52.053081  7285 ts_tablet_manager.cc:1403] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.790s	user 0.018s	sys 0.003s
I20260709 12:26:52.056543  7285 raft_consensus.cc:359] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.277005  7285 raft_consensus.cc:385] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.277354  7285 raft_consensus.cc:740] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.278201  7285 consensus_queue.cc:260] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.195287  7288 tablet_bootstrap.cc:492] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:52.280105  7288 ts_tablet_manager.cc:1403] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 1.307s	user 0.016s	sys 0.015s
I20260709 12:26:52.283507  7288 raft_consensus.cc:359] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.296588  7284 tablet_bootstrap.cc:492] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:52.297309  7284 ts_tablet_manager.cc:1403] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.573s	user 0.023s	sys 0.000s
I20260709 12:26:52.279388  7287 tablet_bootstrap.cc:492] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:52.310382  7287 ts_tablet_manager.cc:1403] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 1.118s	user 0.040s	sys 0.023s
I20260709 12:26:52.284330  7288 raft_consensus.cc:385] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.354998  7288 raft_consensus.cc:740] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.368080  7287 raft_consensus.cc:359] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:52.369746  7287 raft_consensus.cc:385] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.355971  7288 consensus_queue.cc:260] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.370069  7287 raft_consensus.cc:740] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.372248  7287 consensus_queue.cc:260] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:52.371243  7284 raft_consensus.cc:359] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.373482  7284 raft_consensus.cc:385] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.373791  7284 raft_consensus.cc:740] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.374425  7284 consensus_queue.cc:260] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.378355  7287 ts_tablet_manager.cc:1434] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 12:26:52.379608  7287 tablet_bootstrap.cc:492] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:52.510442  7287 tablet_bootstrap.cc:654] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.516539  7631 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:52.517195  7631 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.519202  7631 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:52.519615  7631 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:52.519982  7631 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:52.520969  7633 raft_consensus.cc:493] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:52.521555  7633 raft_consensus.cc:515] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.521867  7631 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:52.522465  7631 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:52.522946  7631 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:52.523811  7633 leader_election.cc:290] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:52.524880  7631 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:52.525398  7633 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:26:52.525846  7633 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.527908  7633 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:52.528537  7633 raft_consensus.cc:493] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:52.529045  7633 raft_consensus.cc:515] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:52.531261  7633 leader_election.cc:290] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:26:52.534106  7057 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.342s	user 0.038s	sys 0.041s
W20260709 12:26:52.535189  7057 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.346s	user 0.039s	sys 0.041s
I20260709 12:26:52.535928  7637 raft_consensus.cc:493] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.536511  7637 raft_consensus.cc:515] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.539299  7637 leader_election.cc:290] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:52.540948  7637 raft_consensus.cc:493] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:52.541586  7236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49174 (request call id 45) took 1561 ms. Trace:
I20260709 12:26:52.542116  7639 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:52.542128  7635 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:52.542222  7236 rpcz_store.cc:276] 0709 12:26:50.980457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:50.984829 (+  4372us) service_pool.cc:224] Handling call
0709 12:26:50.985324 (+   495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:50.985839 (+   515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:50.985885 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:50.986528 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 12:26:51.268676 (+282148us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:26:51.275337 (+  6661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:51.280491 (+  5154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:52.541314 (+1260823us) raft_consensus.cc:1685] finished
0709 12:26:52.541346 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:52.541493 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2246,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":207188,"threads_started":1,"wal-append.queue_time_us":704549}
I20260709 12:26:52.544116  7635 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:52.542840  7639 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.546691  7635 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:52.546766  7632 raft_consensus.cc:493] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:52.541448  7637 raft_consensus.cc:515] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:52.547158  7639 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:52.547294  7632 raft_consensus.cc:515] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.548750  7202 leader_election.cc:304] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:26:52.549062  7637 leader_election.cc:290] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:26:52.549425  7129 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.276s	user 0.017s	sys 0.017s
I20260709 12:26:52.547232  7635 raft_consensus.cc:493] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:52.550578  7638 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:52.550199  7635 raft_consensus.cc:515] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:52.551060  7638 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:52.552424  7635 leader_election.cc:290] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:26:52.550287  7129 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.280s	user 0.018s	sys 0.017s
I20260709 12:26:52.550087  7633 raft_consensus.cc:2804] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:52.555402  7633 raft_consensus.cc:697] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:52.556974  7640 raft_consensus.cc:493] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:52.556545  7633 consensus_queue.cc:237] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.557530  7640 raft_consensus.cc:515] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:52.558897  7639 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:52.559751  7640 leader_election.cc:290] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:52.559841  7639 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.561107  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.553157  7638 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:52.562883  7639 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:52.562963  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.549465  7632 leader_election.cc:290] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:52.560333  7640 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:52.564939  7640 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.565009  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.566490  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.565930  7008 raft_consensus.cc:2468] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:52.568156  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.568987  7630 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.569490  7630 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.570931  7640 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:52.571381  7640 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:52.571625  7630 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:52.571849  7640 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:52.572309  7630 raft_consensus.cc:493] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:52.572842  7630 raft_consensus.cc:515] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.573480  7640 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:52.574769  7630 leader_election.cc:290] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:26:52.574901  7130 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.308s	user 0.014s	sys 0.014s
I20260709 12:26:52.575357  7630 raft_consensus.cc:493] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
W20260709 12:26:52.575757  7130 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.314s	user 0.014s	sys 0.014s
I20260709 12:26:52.576082  7630 raft_consensus.cc:515] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.580757  7630 leader_election.cc:290] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:26:52.583523  7202 leader_election.cc:343] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:52.585363  7202 leader_election.cc:304] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:52.586491  7633 raft_consensus.cc:2804] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:52.586902  7633 raft_consensus.cc:493] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:26:52.587714  7128 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.295s	user 0.003s	sys 0.023s
I20260709 12:26:52.587582  7641 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:52.587893  7633 raft_consensus.cc:3060] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.588647  7641 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.592314  7641 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:52.594161  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:52.594408  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:52.594861  7237 raft_consensus.cc:2468] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:52.597790  7633 raft_consensus.cc:515] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.600792  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:52.601079  7631 raft_consensus.cc:493] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:52.601430  7642 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:52.601614  7631 raft_consensus.cc:515] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.602258  7642 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.601384  7009 raft_consensus.cc:3060] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.603832  7631 leader_election.cc:290] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:52.604782  7642 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:52.605155  7631 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
W20260709 12:26:52.605722  7128 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.314s	user 0.003s	sys 0.025s
I20260709 12:26:52.605695  7631 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.610106  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.611632  7285 ts_tablet_manager.cc:1434] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.558s	user 0.012s	sys 0.000s
W20260709 12:26:52.611990  7285 ts_tablet_manager.cc:1467] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b: Tablet startup took 558ms
I20260709 12:26:52.611238  7009 raft_consensus.cc:2468] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:26:52.613796  7202 leader_election.cc:304] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:52.614748  7528 raft_consensus.cc:2804] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:52.615072  7641 raft_consensus.cc:493] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:26:52.616329  7641 raft_consensus.cc:515] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.618549  7644 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:26:52.612517  7633 leader_election.cc:290] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:52.605494  7642 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:52.620038  7642 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.622853  7642 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:52.623639  7641 leader_election.cc:290] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:52.624267  7641 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.624851  7641 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.625630  7637 raft_consensus.cc:493] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.626317  7637 raft_consensus.cc:515] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.627957  7641 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:52.624784  7635 raft_consensus.cc:493] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:52.631667  7013 raft_consensus.cc:1240] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:52.632683  7013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 70) took 1629 ms. Trace:
I20260709 12:26:52.619102  7644 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.633213  7013 rpcz_store.cc:276] 0709 12:26:51.003410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.630937 (+1627527us) service_pool.cc:224] Handling call
0709 12:26:52.631400 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:52.632336 (+   936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:52.632611 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:52.619295  7288 ts_tablet_manager.cc:1434] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.339s	user 0.014s	sys 0.000s
I20260709 12:26:52.634800  7644 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:52.632275  7635 raft_consensus.cc:515] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.635591  7288 tablet_bootstrap.cc:492] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:52.636821  7635 leader_election.cc:290] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:52.641091  7637 leader_election.cc:290] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:52.615422  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:26:52.612408  7285 ts_tablet_manager.cc:1469] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b: Trace:
0709 12:26:44.055605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.484874 (+429269us) service_pool.cc:224] Handling call
0709 12:26:44.508602 (+ 23728us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.508729 (+   127us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:44.800248 (+291519us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:44.885155 (+ 84907us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:44.903428 (+ 18273us) inbound_call.cc:177] Queueing success response
0709 12:26:51.182270 (+6278842us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:26:52.053492 (+871222us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:26:52.054075 (+   583us) tablet_replica.cc:261] Starting instrumentation
0709 12:26:52.054702 (+   627us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":10019,"raft.queue_time_us":228963,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":119,"tablet-open.queue_time_us":6296732,"thread_start_us":229350,"threads_started":1}
I20260709 12:26:52.645721  7285 tablet_bootstrap.cc:492] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:52.649808  7129 leader_election.cc:304] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:52.651096  7644 raft_consensus.cc:2804] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:52.651562  7644 raft_consensus.cc:493] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:52.652024  7644 raft_consensus.cc:3060] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:52.663942  7131 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.404s	user 0.008s	sys 0.014s
W20260709 12:26:52.664695  7131 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.466s	user 0.008s	sys 0.016s
I20260709 12:26:52.665426  7631 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:52.667193  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:52.672204  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:52.672961  7238 raft_consensus.cc:2468] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:52.673954  7641 raft_consensus.cc:493] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:52.677196  7641 raft_consensus.cc:515] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.680379  7641 leader_election.cc:290] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:52.674024  7631 consensus_queue.cc:1048] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:52.686721  7564 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:26:52.682634  7630 raft_consensus.cc:493] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:52.687273  7564 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.687824  7630 raft_consensus.cc:515] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.690012  7630 leader_election.cc:290] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:52.690570  7630 raft_consensus.cc:493] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
W20260709 12:26:52.683327  7129 leader_election.cc:343] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:52.692082  7129 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:52.693424  7288 tablet_bootstrap.cc:654] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.684206  7650 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:52.694044  7650 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.696734  6910 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48276 (request call id 65) took 1725 ms. Trace:
I20260709 12:26:52.683169  7649 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:52.697129  6910 rpcz_store.cc:276] 0709 12:26:50.970901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:50.978665 (+  7764us) service_pool.cc:224] Handling call
0709 12:26:52.696644 (+1717979us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1713838,"reported_tablets":1}
I20260709 12:26:52.697713  7649 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.693041  7630 raft_consensus.cc:515] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.694535  7646 raft_consensus.cc:2804] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:52.701493  7646 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:26:52.702054  7646 raft_consensus.cc:3060] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.699470  7641 consensus_queue.cc:1048] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:52.702310  7649 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:52.702889  7630 leader_election.cc:290] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:52.703995  7650 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:52.698155  7642 raft_consensus.cc:493] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.709368  7630 raft_consensus.cc:493] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:52.709717  7649 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:52.709895  7630 raft_consensus.cc:515] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.710278  7649 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.712147  7641 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:52.712437  7650 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:26:52.712872  7641 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.713155  7650 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.715068  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:52.715735  7239 raft_consensus.cc:2468] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:52.716204  7649 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:52.718914  7637 raft_consensus.cc:493] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:52.717821  7642 raft_consensus.cc:515] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.725185  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:52.726478  7642 leader_election.cc:290] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:52.726457  7648 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:52.727734  7648 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.719592  7637 raft_consensus.cc:515] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:52.728188  7495 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:52.719751  7635 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:26:52.732275  7650 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:52.733695  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:52.724390  7644 raft_consensus.cc:515] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.735416  7637 leader_election.cc:290] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:52.735935  7635 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.736179  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:52.738121  7285 tablet_bootstrap.cc:654] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:52.720014  7641 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:52.781661  7642 raft_consensus.cc:493] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.783037  7647 raft_consensus.cc:493] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:52.782986  7642 raft_consensus.cc:515] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.783900  7647 raft_consensus.cc:515] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.785935  7642 leader_election.cc:290] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:52.729130  7528 raft_consensus.cc:697] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:52.793396  7652 raft_consensus.cc:493] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:52.795071  7639 raft_consensus.cc:493] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:26:52.741180  7238 raft_consensus.cc:2468] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:52.736799  7495 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.804603  7288 tablet_bootstrap.cc:492] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:52.805464  7288 ts_tablet_manager.cc:1403] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.170s	user 0.031s	sys 0.023s
I20260709 12:26:52.806380  7645 raft_consensus.cc:493] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.806936  7645 raft_consensus.cc:515] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.808938  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:52.809643  7648 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:52.799942  7639 raft_consensus.cc:515] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.813059  7637 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:26:52.808415  7055 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.630s	user 0.017s	sys 0.071s
I20260709 12:26:52.813611  7637 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.822613  7645 leader_election.cc:290] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:52.823458  7647 leader_election.cc:290] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:52.802402  7652 raft_consensus.cc:515] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.824824  7646 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:26:52.826538  7055 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.648s	user 0.017s	sys 0.071s
I20260709 12:26:52.840785  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.841094  7632 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:52.841900  7012 raft_consensus.cc:2468] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:52.842175  7632 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:52.844457  7632 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:52.796223  7528 consensus_queue.cc:237] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.838017  7642 raft_consensus.cc:493] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:52.852159  7642 raft_consensus.cc:515] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.854319  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:52.854960  7015 raft_consensus.cc:3060] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:52.855281  7642 leader_election.cc:290] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:52.856819  7646 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:52.856737  7648 consensus_queue.cc:1059] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.857677  7648 raft_consensus.cc:3055] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:52.858024  7648 raft_consensus.cc:740] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:52.858800  7648 consensus_queue.cc:260] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.859022  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.860539  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:52.861332  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:52.862021  7236 raft_consensus.cc:2468] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:52.862753  7644 leader_election.cc:290] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:52.848841  7632 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:52.864082  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:52.864763  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:52.865377  7237 raft_consensus.cc:3060] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.866696  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:52.867779  7631 raft_consensus.cc:493] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.868271  7631 raft_consensus.cc:515] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.864504  7632 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.870066  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.870885  7631 leader_election.cc:290] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:52.847152  7640 raft_consensus.cc:493] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:52.872393  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.872373  7640 raft_consensus.cc:515] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.873276  7013 raft_consensus.cc:2468] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:52.864010  7129 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:52.874536  7640 leader_election.cc:290] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:52.875651  7129 leader_election.cc:304] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:52.859961  7648 raft_consensus.cc:3060] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.879464  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.880221  7013 raft_consensus.cc:2468] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
W20260709 12:26:52.882161  7054 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.614s	user 0.050s	sys 0.094s
I20260709 12:26:52.882436  7237 raft_consensus.cc:2468] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:26:52.883227  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.891912  7636 raft_consensus.cc:493] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:52.892529  7636 raft_consensus.cc:515] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.894623  7015 raft_consensus.cc:2468] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:52.894786  7636 leader_election.cc:290] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:52.898769  7639 leader_election.cc:290] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:52.900441  7635 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:52.885599  7646 raft_consensus.cc:2804] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:52.885859  7644 raft_consensus.cc:2804] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:52.903585  7632 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:52.903972  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:52.904294  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:52.905478  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:52.905850  7495 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:52.919541  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:52.919902  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:52.920233  7239 raft_consensus.cc:3060] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.922351  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:52.922600  7631 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.923130  7631 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:52.924011  7235 raft_consensus.cc:1240] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:52.888280  7054 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.623s	user 0.050s	sys 0.094s
I20260709 12:26:52.924693  7087 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:52.925364  7631 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:52.925458  7088 raft_consensus.cc:2468] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:52.911664  7646 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.926659  7646 raft_consensus.cc:3060] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.928647  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:26:52.929253  7203 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.233s	user 0.055s	sys 0.092s
I20260709 12:26:52.929891  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.930094  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.931034  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.931301  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.931818  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.910869  7647 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.905794  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:52.932972  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.933161  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:52.922076  7285 tablet_bootstrap.cc:492] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:52.933794  7161 raft_consensus.cc:2468] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:26:52.933890  7129 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:52.926549  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:52.934311  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.935369  7653 raft_consensus.cc:2804] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:52.935531  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.932919  7647 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.935789  7129 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:52.936712  7649 consensus_queue.cc:1048] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.936924  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:52.937275  7288 raft_consensus.cc:359] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.934121  7285 ts_tablet_manager.cc:1403] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.289s	user 0.019s	sys 0.003s
I20260709 12:26:52.937958  7288 raft_consensus.cc:385] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.938294  7288 raft_consensus.cc:740] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
W20260709 12:26:52.939087  7284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.001s	sys 0.002s
W20260709 12:26:52.939384  7284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.001s	sys 0.002s
I20260709 12:26:52.917006  7202 leader_election.cc:304] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:52.939911  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:52.908111  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:52.932462  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.940920  7631 raft_consensus.cc:2804] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:52.911713  7644 raft_consensus.cc:493] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:52.941804  7644 raft_consensus.cc:3060] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.920636  7089 raft_consensus.cc:2468] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:52.937649  7164 raft_consensus.cc:2393] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 1: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:26:52.940877  7083 raft_consensus.cc:2468] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:52.935801  7653 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:26:52.943497  7653 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.944083  7284 ts_tablet_manager.cc:1434] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.646s	user 0.011s	sys 0.004s
I20260709 12:26:52.933409  7086 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:26:52.949055  7640 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:26:52.944422  7284 ts_tablet_manager.cc:1467] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca: Tablet startup took 646ms
I20260709 12:26:52.944388  7285 raft_consensus.cc:359] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.938086  7649 raft_consensus.cc:2804] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:52.938943  7288 consensus_queue.cc:260] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:26:52.951195  7203 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.255s	user 0.055s	sys 0.092s
I20260709 12:26:52.932231  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.951045  7632 raft_consensus.cc:493] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.954146  7632 raft_consensus.cc:515] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.951001  7285 raft_consensus.cc:385] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:52.956830  7285 raft_consensus.cc:740] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:52.941429  7631 raft_consensus.cc:493] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.957656  7285 consensus_queue.cc:260] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.962040  7632 leader_election.cc:290] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:52.963764  7288 ts_tablet_manager.cc:1434] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.158s	user 0.006s	sys 0.001s
I20260709 12:26:52.958348  7649 raft_consensus.cc:697] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:52.971091  7649 consensus_queue.cc:237] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.955156  7640 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:52.975153  7640 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:52.975032  7646 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.976461  7165 raft_consensus.cc:1240] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:52.950306  7284 ts_tablet_manager.cc:1469] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca: Trace:
0709 12:26:43.935269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.435501 (+500232us) service_pool.cc:224] Handling call
0709 12:26:44.471651 (+ 36150us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d248831 00007f287d225ac3 00007f287d1d4400 00007f2876659af4 00007f2876659a82 00007f28766599b1
0709 12:26:44.471789 (+   138us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.471876 (+    87us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:44.714294 (+242418us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:44.905368 (+191074us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:44.918373 (+ 13005us) inbound_call.cc:177] Queueing success response
0709 12:26:51.716681 (+6798308us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:26:52.297674 (+580993us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:26:52.298328 (+   654us) tablet_replica.cc:261] Starting instrumentation
0709 12:26:52.299016 (+   688us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":9,"raft.queue_time_us":141135,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":111,"spinlock_wait_cycles":28021504,"tablet-open.queue_time_us":6798398,"thread_start_us":559692,"threads_started":1}
I20260709 12:26:52.912940  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:52.998095  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:52.998728  7653 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:52.966878  7631 raft_consensus.cc:3060] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.001012  7653 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:53.001857  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.002489  7287 tablet_bootstrap.cc:492] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:53.003111  7287 ts_tablet_manager.cc:1403] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.624s	user 0.017s	sys 0.000s
I20260709 12:26:53.006884  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:52.994993  7638 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.964359  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:53.008141  7632 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.958202  7642 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:53.008699  7632 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:53.009393  7642 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:53.008198  7638 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:53.015223  6914 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48280 (request call id 62) took 2035 ms. Trace:
I20260709 12:26:53.015745  6914 rpcz_store.cc:276] 0709 12:26:50.980136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:50.980278 (+   142us) service_pool.cc:224] Handling call
0709 12:26:53.015162 (+2034884us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":183,"reported_tablets":1}
W20260709 12:26:53.017092  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:53.017526  7288 tablet_bootstrap.cc:492] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:53.014272  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.023146  7642 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:53.024873  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.026566  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.027247  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.027896  7083 raft_consensus.cc:2468] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:53.028748  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.030633  7284 tablet_bootstrap.cc:492] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:53.028986  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.032582  7287 raft_consensus.cc:359] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:53.033463  7287 raft_consensus.cc:385] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.033890  7287 raft_consensus.cc:740] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.033492  7055 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:53.029126  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:53.041708  7055 leader_election.cc:343] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:53.028462  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.074419  7287 consensus_queue.cc:260] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:53.038683  7640 raft_consensus.cc:2804] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:53.075784  7285 ts_tablet_manager.cc:1434] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.138s	user 0.012s	sys 0.016s
I20260709 12:26:53.043555  7087 raft_consensus.cc:3060] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.039134  7528 raft_consensus.cc:493] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:53.036732  7082 raft_consensus.cc:2468] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:53.072008  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.074617  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.072233  7091 raft_consensus.cc:2468] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:53.077376  7640 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:53.093119  7287 ts_tablet_manager.cc:1434] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.090s	user 0.012s	sys 0.000s
W20260709 12:26:53.071631  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 95216.9us
I20260709 12:26:53.079180  7646 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:53.085222  7632 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:53.095979  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:53.084730  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:53.099591  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.098927  7285 tablet_bootstrap.cc:492] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:53.094818  7640 raft_consensus.cc:3060] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.105450  7287 tablet_bootstrap.cc:492] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:53.099941  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.100365  7161 raft_consensus.cc:2468] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:26:53.101749  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.103678  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:53.104337  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:53.109304  7239 raft_consensus.cc:2468] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:26:53.116503  7288 tablet_bootstrap.cc:654] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.122066  7637 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:26:53.122800  7205 leader_election.cc:343] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:53.124264  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:53.124884  7238 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.125036  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:53.126436  7644 raft_consensus.cc:515] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:53.132166  7160 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:53.085805  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 127101us
I20260709 12:26:53.104662  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.091228  7528 raft_consensus.cc:515] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:53.095263  7631 raft_consensus.cc:515] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:53.155979  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.141963  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:53.166608  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.146135  7638 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:53.172631  7091 raft_consensus.cc:2468] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:53.175997  7640 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:53.177991  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.179347  7640 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:53.171815  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.180889  7164 raft_consensus.cc:2393] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 2: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:26:53.183334  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:53.184005  7233 raft_consensus.cc:3060] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.184453  7631 leader_election.cc:290] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:26:53.195176  7131 leader_election.cc:343] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:53.171154  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.196585  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.196897  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.197552  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:53.198757  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:53.198944  7648 consensus_queue.cc:1048] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:53.199133  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.200230  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:53.200657  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.200870  7016 raft_consensus.cc:2468] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 0.
I20260709 12:26:53.201851  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.202368  7131 leader_election.cc:304] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:53.203399  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.204226  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.152256  7205 leader_election.cc:304] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:53.186281  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.204253  7284 tablet_bootstrap.cc:654] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.205034  7054 leader_election.cc:304] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:53.205097  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:53.205538  6982 leader_election.cc:343] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:53.237082  6982 leader_election.cc:304] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:53.235749  7641 raft_consensus.cc:2804] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:26:53.198823  7128 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.239423  7641 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.239934  7641 raft_consensus.cc:3060] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.191545  7238 raft_consensus.cc:2468] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:26:53.199077  7632 raft_consensus.cc:493] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.240705  7632 raft_consensus.cc:515] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:53.200883  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:53.241899  7014 raft_consensus.cc:2468] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 0.
I20260709 12:26:53.208339  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:53.243777  7236 raft_consensus.cc:2393] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 1: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:26:53.214699  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.214880  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.217331  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.216503  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.226354  7652 leader_election.cc:290] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:53.228233  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.228505  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.220815  7285 tablet_bootstrap.cc:654] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.238855  7637 raft_consensus.cc:2804] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:53.220753  7664 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:53.248287  7287 tablet_bootstrap.cc:654] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:53.248814  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 46547.6us
I20260709 12:26:53.249433  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.251401  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:53.251803  7091 raft_consensus.cc:3060] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.251865  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.206569  7086 raft_consensus.cc:2468] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:53.252167  7008 raft_consensus.cc:3060] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.250825  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.247592  7644 leader_election.cc:290] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:53.271802  7642 raft_consensus.cc:2749] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:53.289580  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:53.290195  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.279992  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.287216  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:53.280669  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 75699.3us
I20260709 12:26:53.284207  7007 raft_consensus.cc:3060] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.291052  7131 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:53.276722  7162 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:26:53.276865  7637 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:53.278903  7161 raft_consensus.cc:2468] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:26:53.287616  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:26:53.284427  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 43749.8us
W20260709 12:26:53.285873  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 163156us
I20260709 12:26:53.294819  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:53.305809  7670 raft_consensus.cc:2749] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:53.302421  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:26:53.309221  7205 leader_election.cc:343] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:53.310271  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:53.313580  7673 consensus_queue.cc:1048] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:26:53.314172  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:53.300768  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.315618  7230 raft_consensus.cc:1240] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:53.310282  7205 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:53.281662  7129 leader_election.cc:304] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:53.317454  7083 raft_consensus.cc:3060] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.320518  7528 leader_election.cc:290] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:26:53.322638  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 45361.7us
I20260709 12:26:53.324048  7129 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:53.324903  7649 raft_consensus.cc:2804] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:53.301379  7637 raft_consensus.cc:3060] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.331614  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:53.333105  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.334112  7647 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:53.334421  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.335541  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.311602  7644 raft_consensus.cc:2804] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:53.348984  7285 tablet_bootstrap.cc:492] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:53.349210  7284 tablet_bootstrap.cc:492] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:53.349819  7285 ts_tablet_manager.cc:1403] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.256s	user 0.011s	sys 0.003s
I20260709 12:26:53.349954  7284 ts_tablet_manager.cc:1403] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.320s	user 0.008s	sys 0.007s
I20260709 12:26:53.301579  7631 consensus_queue.cc:1048] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 12:26:53.361310  7205 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:53.362357  7205 leader_election.cc:304] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:53.363175  7205 leader_election.cc:304] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:53.364662  7007 raft_consensus.cc:2468] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:53.364784  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.366305  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:53.367007  7164 raft_consensus.cc:3060] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.367246  7564 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:53.367954  7673 raft_consensus.cc:2804] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:53.368363  7673 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:53.368750  7673 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.285506  7664 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:53.359171  7233 raft_consensus.cc:2468] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:26:53.343129  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.356989  7649 raft_consensus.cc:697] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:53.340284  7528 raft_consensus.cc:2804] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:53.376019  7205 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:53.379911  7055 leader_election.cc:304] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:53.384768  7640 raft_consensus.cc:2749] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:53.369050  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.385365  7664 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:53.386220  7288 tablet_bootstrap.cc:492] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:53.386363  7667 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.386739  7288 ts_tablet_manager.cc:1403] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.370s	user 0.012s	sys 0.009s
I20260709 12:26:53.386938  7667 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:53.389171  7667 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:53.389695  7667 raft_consensus.cc:2804] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:53.390097  7667 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:53.390463  7667 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:53.390797  7288 raft_consensus.cc:359] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:53.391881  7288 raft_consensus.cc:385] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.392297  7288 raft_consensus.cc:740] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.392974  7288 consensus_queue.cc:260] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:53.395747  7288 ts_tablet_manager.cc:1434] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 12:26:53.396607  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:53.396962  7236 raft_consensus.cc:2468] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:26:53.396656  7649 consensus_queue.cc:237] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:53.397087  7054 leader_election.cc:304] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:53.397496  7234 raft_consensus.cc:1240] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:53.339936  7131 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:53.398649  7634 raft_consensus.cc:2804] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:53.381052  7631 raft_consensus.cc:2804] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:53.345367  7644 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:53.399621  7675 raft_consensus.cc:2804] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:53.410224  7285 raft_consensus.cc:359] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:53.401683  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:53.417655  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.418514  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:53.327080  7128 leader_election.cc:304] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:53.383025  7232 raft_consensus.cc:1240] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:53.375676  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:53.427493  7157 raft_consensus.cc:2468] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:26:53.421140  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:53.432264  7284 raft_consensus.cc:359] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:53.434751  7288 tablet_bootstrap.cc:492] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:53.500202  7284 raft_consensus.cc:385] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.439004  7285 raft_consensus.cc:385] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.500978  7285 raft_consensus.cc:740] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.434140  7055 leader_election.cc:304] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:53.439531  7164 raft_consensus.cc:2468] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:26:53.382917  7528 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:53.449873  7086 raft_consensus.cc:2468] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:53.439213  7644 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.511081  7638 raft_consensus.cc:2749] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:53.511852  7235 raft_consensus.cc:2468] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 0.
I20260709 12:26:53.514671  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:53.433882  7640 raft_consensus.cc:2749] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:53.431857  7631 raft_consensus.cc:493] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:53.515455  7235 raft_consensus.cc:3060] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.438508  7634 raft_consensus.cc:493] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:53.493031  7630 leader_election.cc:290] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:26:53.489818  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 152499us
W20260709 12:26:53.499516  6980 leader_election.cc:343] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:53.551240  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 51793.6us
I20260709 12:26:53.516502  7637 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:53.440629  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:53.447768  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 68889.8us
W20260709 12:26:53.504026  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 70008.7us
I20260709 12:26:53.500532  7284 raft_consensus.cc:740] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.439721  7202 leader_election.cc:304] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:53.504463  7680 raft_consensus.cc:2749] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:53.511080  7528 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.517254  7285 consensus_queue.cc:260] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:53.549288  7288 tablet_bootstrap.cc:654] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.433264  7564 raft_consensus.cc:493] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.399854  7642 consensus_queue.cc:1059] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:26:53.557392  7055 leader_election.cc:304] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:26:53.518889  7260 debug-util.cc:398] Leaking SignalData structure 0x7b08003814e0 after lost signal to thread 3876
I20260709 12:26:53.569787  7011 raft_consensus.cc:1240] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:53.574386  7260 debug-util.cc:398] Leaking SignalData structure 0x7b080036de80 after lost signal to thread 6948
W20260709 12:26:53.575578  7260 debug-util.cc:398] Leaking SignalData structure 0x7b08000a1980 after lost signal to thread 7040
I20260709 12:26:53.488207  7667 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:53.517712  7634 raft_consensus.cc:3060] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.517069  7631 raft_consensus.cc:3060] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.572224  7284 consensus_queue.cc:260] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:53.501134  7675 raft_consensus.cc:697] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:53.550108  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:53.563148  7646 raft_consensus.cc:2749] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:53.581101  7260 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3fa0 after lost signal to thread 7115
I20260709 12:26:53.599800  7285 ts_tablet_manager.cc:1434] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.249s	user 0.011s	sys 0.006s
I20260709 12:26:53.578128  7633 raft_consensus.cc:2804] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:26:53.571058  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 71698.2us
W20260709 12:26:53.572625  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 143591us
W20260709 12:26:53.577244  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 251707us
I20260709 12:26:53.578856  7054 leader_election.cc:304] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:53.578979  7564 raft_consensus.cc:515] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:53.679718  7010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 104) took 1007 ms. Trace:
W20260709 12:26:53.680730  7682 log.cc:927] Time spent T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:26:53.681880  7564 leader_election.cc:290] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:53.682808  7285 tablet_bootstrap.cc:492] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:53.578333  7131 leader_election.cc:304] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
W20260709 12:26:53.685777  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 128465us
I20260709 12:26:53.691432  7287 tablet_bootstrap.cc:492] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:53.692180  7287 ts_tablet_manager.cc:1403] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.595s	user 0.028s	sys 0.022s
I20260709 12:26:53.672910  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:53.673683  7653 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.674535  7633 raft_consensus.cc:697] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
W20260709 12:26:53.704905  7205 consensus_peers.cc:597] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 -> Peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Couldn't send request to peer 9e6e5c8ad44447588681b10df7ad79ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.703070  7260 debug-util.cc:398] Leaking SignalData structure 0x7b08002bcae0 after lost signal to thread 7189
I20260709 12:26:53.710038  6980 leader_election.cc:304] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:53.707880  7653 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:53.716805  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:53.718273  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:53.718829  7653 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:53.713400  7652 consensus_queue.cc:1048] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:26:53.719419  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:53.713694  7084 raft_consensus.cc:1240] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:53.707736  7129 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:53.701709  7670 consensus_queue.cc:1048] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
W20260709 12:26:53.707139  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 138098us
I20260709 12:26:53.699218  7128 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:53.688112  7675 consensus_queue.cc:237] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:53.680212  7010 rpcz_store.cc:276] 0709 12:26:52.552719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.440376 (+887657us) service_pool.cc:224] Handling call
0709 12:26:53.494388 (+ 54012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:53.503520 (+  9132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:53.511304 (+  7784us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:53.547313 (+ 36009us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:53.549858 (+  2545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:53.559882 (+ 10024us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:53.560015 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:53.724072  6980 leader_election.cc:304] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:53.742033  6980 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:26:53.720642  7686 log.cc:927] Time spent T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.134s	user 0.000s	sys 0.005s
I20260709 12:26:53.722045  7633 consensus_queue.cc:237] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:53.731459  7688 raft_consensus.cc:2804] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:53.732081  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:53.732293  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:53.753743  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:53.753774  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:53.735383  7646 raft_consensus.cc:2804] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:53.722364  7637 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:53.736694  7013 raft_consensus.cc:1275] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.736769  7652 raft_consensus.cc:2749] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:53.736750  7160 raft_consensus.cc:1240] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:53.687861  7644 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:53.737674  7641 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:26:53.738294  7260 debug-util.cc:398] Leaking SignalData structure 0x7b08002230c0 after lost signal to thread 7263
I20260709 12:26:53.727193  7131 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:53.751536  7662 raft_consensus.cc:2749] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:53.751670  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 65812.8us
I20260709 12:26:53.741465  7653 raft_consensus.cc:2804] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:53.720530  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:53.722092  7667 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:53.739666  7673 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:53.748179  7647 raft_consensus.cc:2749] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:53.750650  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 51580us
I20260709 12:26:53.847980  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:53.849820  7235 raft_consensus.cc:2468] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:26:53.724680  7634 raft_consensus.cc:515] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:53.757002  7646 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:53.856477  7285 tablet_bootstrap.cc:654] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:53.756156  7688 raft_consensus.cc:493] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:53.754863  7635 consensus_queue.cc:1048] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.102s
I20260709 12:26:53.872848  7157 raft_consensus.cc:1240] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:53.875032  7634 leader_election.cc:290] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:53.881608  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.860174  7128 leader_election.cc:304] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:53.858457  7653 raft_consensus.cc:697] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:53.885505  7129 leader_election.cc:304] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:53.887144  7692 raft_consensus.cc:2749] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:53.863726  7159 raft_consensus.cc:1240] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:53.862329  7646 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.885313  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:53.900997  7165 raft_consensus.cc:2393] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 1: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:26:53.913407  7235 raft_consensus.cc:2468] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:53.914865  7235 raft_consensus.cc:1240] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:53.916148  7235 raft_consensus.cc:1240] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:53.904585  7239 raft_consensus.cc:1240] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:53.917526  7641 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:53.918887  7673 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:53.919625  7129 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:26:53.920809  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 66774us
I20260709 12:26:53.921500  7692 raft_consensus.cc:2804] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:53.921921  7692 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.922374  7692 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.905804  7287 raft_consensus.cc:359] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:53.863665  7688 raft_consensus.cc:3060] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:53.864213  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 137078us
I20260709 12:26:53.923188  7287 raft_consensus.cc:385] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:53.929050  7287 raft_consensus.cc:740] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.922115  7635 consensus_queue.cc:1059] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:53.930449  7287 consensus_queue.cc:260] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:53.920409  7644 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:53.912784  7649 raft_consensus.cc:2804] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:53.909188  7160 raft_consensus.cc:2468] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:53.914857  7230 raft_consensus.cc:1240] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:53.921900  7675 consensus_queue.cc:1059] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:53.968920  7653 consensus_queue.cc:237] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:53.971293  7652 consensus_queue.cc:1059] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.972407  7652 raft_consensus.cc:3055] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:53.972775  7652 raft_consensus.cc:740] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:53.973587  7652 consensus_queue.cc:260] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:53.974785  7652 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:53.924817  7564 raft_consensus.cc:2804] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:53.935894  7649 raft_consensus.cc:493] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:26:53.976766  7649 raft_consensus.cc:3060] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.945026  7662 consensus_queue.cc:1059] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:26:53.970338  7288 tablet_bootstrap.cc:492] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:53.978154  6980 leader_election.cc:304] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:53.979235  7287 ts_tablet_manager.cc:1434] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.287s	user 0.008s	sys 0.005s
I20260709 12:26:53.921900  7128 leader_election.cc:304] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:53.941394  7634 raft_consensus.cc:493] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.979882  7288 ts_tablet_manager.cc:1403] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.552s	user 0.045s	sys 0.022s
I20260709 12:26:53.980273  7564 raft_consensus.cc:697] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:53.981454  7635 raft_consensus.cc:2804] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:53.986481  7287 tablet_bootstrap.cc:492] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:53.984907  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:53.985410  7635 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.987716  7635 raft_consensus.cc:3060] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.985673  7634 raft_consensus.cc:515] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:53.991118  7634 leader_election.cc:290] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:53.984973  7564 consensus_queue.cc:237] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:53.996302  7157 raft_consensus.cc:1240] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:53.996608  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 74806.2us
I20260709 12:26:53.998287  7128 leader_election.cc:304] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:53.998801  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:53.999275  7637 consensus_queue.cc:1059] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:54.000424  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:54.001116  7235 raft_consensus.cc:3060] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:53.996306  7644 raft_consensus.cc:2804] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:54.006239  7631 raft_consensus.cc:515] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:54.006871  7632 leader_election.cc:290] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:53.988471  7160 raft_consensus.cc:1240] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:54.016057  7637 consensus_queue.cc:1243] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer 022925662268440c91fff7e8732d7a0b log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:26:54.004238  7653 raft_consensus.cc:2749] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:54.036187  7694 log.cc:927] Time spent T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:26:54.038993  7287 tablet_bootstrap.cc:654] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.038800  7631 leader_election.cc:290] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:26:54.048152  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:54.013375  7128 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:54.047940  7635 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:54.024389  7637 consensus_queue.cc:1059] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
W20260709 12:26:54.053637  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 48227.9us
I20260709 12:26:54.016542  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:54.016868  7528 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:54.056324  7648 raft_consensus.cc:2749] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.061094  7646 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:54.067554  7646 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:54.057816  7668 consensus_queue.cc:1048] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:26:54.069092  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:54.073257  7703 raft_consensus.cc:3055] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:54.073705  7703 raft_consensus.cc:740] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:54.051227  7230 raft_consensus.cc:1240] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:54.075569  7238 raft_consensus.cc:1240] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:54.076593  7528 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:54.018568  7692 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:54.082679  7285 tablet_bootstrap.cc:492] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:54.083185  7285 ts_tablet_manager.cc:1403] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.401s	user 0.010s	sys 0.012s
I20260709 12:26:54.083652  7164 raft_consensus.cc:3060] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.058732  7644 raft_consensus.cc:697] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:54.088239  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:54.092473  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:54.096228  7692 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:26:54.097337  7687 log.cc:927] Time spent T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.498s	user 0.008s	sys 0.000s
I20260709 12:26:54.099390  6980 leader_election.cc:304] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:26:54.100397  7202 leader_election.cc:343] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.103996  7638 raft_consensus.cc:3055] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:54.104508  7638 raft_consensus.cc:740] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:26:54.104683  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:54.105464  7638 consensus_queue.cc:260] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:54.106765  7638 raft_consensus.cc:3060] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.100795  7162 raft_consensus.cc:1240] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:26:54.113078  7285 raft_consensus.cc:359] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:54.114738  7285 raft_consensus.cc:385] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.114974  7285 raft_consensus.cc:740] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.116706  7284 ts_tablet_manager.cc:1434] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.766s	user 0.010s	sys 0.000s
W20260709 12:26:54.117013  7284 ts_tablet_manager.cc:1467] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca: Tablet startup took 766ms
I20260709 12:26:54.119716  7239 raft_consensus.cc:1275] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:54.117285  7284 ts_tablet_manager.cc:1469] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca: Trace:
0709 12:26:43.934011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.362276 (+428265us) service_pool.cc:224] Handling call
0709 12:26:44.437179 (+ 74903us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.438609 (+  1430us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:44.703356 (+264747us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:44.924017 (+220661us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:44.924494 (+   477us) inbound_call.cc:177] Queueing success response
0709 12:26:52.996209 (+8071715us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:26:53.350464 (+354255us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:26:53.351176 (+   712us) tablet_replica.cc:261] Starting instrumentation
0709 12:26:53.351951 (+   775us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":521321,"tablet-open.queue_time_us":8071741}
I20260709 12:26:54.133034  7691 raft_consensus.cc:2749] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:54.135871  7284 tablet_bootstrap.cc:492] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:54.137346  7288 raft_consensus.cc:359] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:54.138371  7288 raft_consensus.cc:385] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.138880  7288 raft_consensus.cc:740] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.139714  7288 consensus_queue.cc:260] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:54.118494  7637 raft_consensus.cc:2749] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:54.145063  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 456648us
I20260709 12:26:54.145392  7285 consensus_queue.cc:260] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:54.120738  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
W20260709 12:26:54.145824  7055 leader_election.cc:343] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.148283  7055 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:26:54.146123  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 46810.9us
I20260709 12:26:54.149333  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:54.150029  7055 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:54.151741  7288 ts_tablet_manager.cc:1434] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.170s	user 0.005s	sys 0.005s
I20260709 12:26:54.152741  7055 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:54.154090  7288 tablet_bootstrap.cc:492] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:54.154814  7205 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:54.156315  7205 leader_election.cc:304] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:54.156867  7285 ts_tablet_manager.cc:1434] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.002s
I20260709 12:26:54.158329  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:54.159502  7205 leader_election.cc:304] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:54.159852  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:54.160374  7091 raft_consensus.cc:3060] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.142697  7632 consensus_queue.cc:1059] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:26:54.157814  7706 raft_consensus.cc:493] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.158507  7691 raft_consensus.cc:2804] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:54.180910  7690 raft_consensus.cc:2804] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.181229  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:54.166006  7635 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:54.153549  7642 raft_consensus.cc:2804] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:54.173061  7235 raft_consensus.cc:2468] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:54.170634  7631 consensus_queue.cc:1059] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:26:54.168744  7668 raft_consensus.cc:2749] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.179092  7284 tablet_bootstrap.cc:654] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.140635  7644 consensus_queue.cc:237] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:26:54.152917  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 583348us
W20260709 12:26:54.170372  7698 log.cc:927] Time spent T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:26:54.165164  7528 raft_consensus.cc:2749] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.182614  7690 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.153981  7692 consensus_queue.cc:1048] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:26:54.169993  7285 tablet_bootstrap.cc:492] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:54.185751  7642 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:54.186952  7287 tablet_bootstrap.cc:492] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:54.202595  7287 ts_tablet_manager.cc:1403] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.216s	user 0.014s	sys 0.015s
I20260709 12:26:54.183125  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:54.186756  7634 raft_consensus.cc:2764] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:26:54.199661  7055 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:54.199366  7129 leader_election.cc:304] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:26:54.207830  7203 leader_election.cc:343] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.208295  7203 leader_election.cc:304] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:54.184849  7703 consensus_queue.cc:260] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:54.214076  7091 raft_consensus.cc:2468] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:26:54.214275  7703 raft_consensus.cc:3060] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.222051  7055 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:54.224576  7632 raft_consensus.cc:2749] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.204909  7642 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.181424  7704 consensus_queue.cc:1059] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.120s
I20260709 12:26:54.205565  7690 raft_consensus.cc:3060] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.182704  7711 raft_consensus.cc:2804] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:54.221405  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:54.225097  7668 raft_consensus.cc:2749] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:54.199873  7688 raft_consensus.cc:515] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:54.251041  7712 raft_consensus.cc:3055] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:54.251556  7712 raft_consensus.cc:740] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:26:54.250404  7055 leader_election.cc:304] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:54.253381  7203 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:54.229548  7054 leader_election.cc:304] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:54.246302  7711 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:54.279850  7161 raft_consensus.cc:1240] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:54.281062  7233 raft_consensus.cc:1275] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.186249  7706 raft_consensus.cc:515] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:54.262749  7712 consensus_queue.cc:260] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:54.322356  7712 raft_consensus.cc:3060] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.282864  7711 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:54.328008  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 74676.5us
I20260709 12:26:54.323185  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:54.330332  7158 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56784 (request call id 48) took 1187 ms. Trace:
I20260709 12:26:54.330639  7688 leader_election.cc:290] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:54.330706  7158 rpcz_store.cc:276] 0709 12:26:53.156915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.200789 (+1043874us) service_pool.cc:224] Handling call
0709 12:26:54.330270 (+129481us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:54.331986  7665 raft_consensus.cc:2804] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:54.332680  7665 raft_consensus.cc:697] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:54.334048  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:54.334144  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:54.336298  7647 raft_consensus.cc:3055] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:54.336761  7647 raft_consensus.cc:740] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:54.337052  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:54.332686  7635 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:54.337628  7647 consensus_queue.cc:260] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:54.338742  7647 raft_consensus.cc:3060] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.338521  7635 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:54.345232  7203 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:54.366575  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:54.367590  7635 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:54.371068  7233 raft_consensus.cc:1275] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.374393  7162 raft_consensus.cc:1240] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:54.375289  7638 raft_consensus.cc:2749] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.376226  7638 raft_consensus.cc:2749] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:54.319020  7691 raft_consensus.cc:697] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:26:54.378717  7285 tablet_bootstrap.cc:654] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.378875  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
W20260709 12:26:54.389000  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 43897.7us
I20260709 12:26:54.394178  7203 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:54.390057  7631 raft_consensus.cc:2749] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.399746  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:54.402807  7287 raft_consensus.cc:359] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:54.403772  7287 raft_consensus.cc:385] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.403641  7128 leader_election.cc:304] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:54.404273  7287 raft_consensus.cc:740] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.405441  7287 consensus_queue.cc:260] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:26:54.414564  7203 leader_election.cc:343] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.419031  7644 consensus_queue.cc:1048] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:54.430045  7163 raft_consensus.cc:1275] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.327320  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:54.430109  7667 raft_consensus.cc:2749] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.433799  7287 ts_tablet_manager.cc:1434] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.231s	user 0.007s	sys 0.002s
I20260709 12:26:54.436342  7233 raft_consensus.cc:1240] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:54.439611  7288 tablet_bootstrap.cc:654] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.408861  7704 raft_consensus.cc:2749] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.310427  7709 consensus_queue.cc:1059] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.222s
I20260709 12:26:54.432431  7631 consensus_queue.cc:1059] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:26:54.461689  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:54.432700  7156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56794 (request call id 102) took 1298 ms. Trace:
I20260709 12:26:54.456754  7644 consensus_queue.cc:1048] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
W20260709 12:26:54.480705  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 64045.1us
I20260709 12:26:54.464529  7716 raft_consensus.cc:2804] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:54.472841  7723 consensus_queue.cc:1059] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
W20260709 12:26:54.459944  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 238712us
I20260709 12:26:54.378674  7691 consensus_queue.cc:237] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:54.474264  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:26:54.485838  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 235481us
I20260709 12:26:54.475054  7683 raft_consensus.cc:2749] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:54.482923  7203 leader_election.cc:343] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:54.487103  7205 leader_election.cc:304] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:54.444299  7635 consensus_queue.cc:1048] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
W20260709 12:26:54.453707  7131 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.200.66:36713 timed out after 1.654s (SENT) [suppressed 9 similar messages]
I20260709 12:26:54.460788  7637 consensus_queue.cc:1059] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:26:54.509200  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:54.488734  7232 raft_consensus.cc:1240] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:54.491730  7709 consensus_queue.cc:1243] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer 022925662268440c91fff7e8732d7a0b log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:26:54.489691  7716 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:54.512812  7054 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:54.513774  7719 raft_consensus.cc:2804] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:54.522094  7237 raft_consensus.cc:1240] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:54.523342  7637 raft_consensus.cc:3055] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:54.440778  7665 consensus_queue.cc:237] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:54.497077  7664 consensus_queue.cc:1048] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:26:54.542387  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:54.479760  7156 rpcz_store.cc:276] 0709 12:26:53.134306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.142649 (+  8343us) service_pool.cc:224] Handling call
0709 12:26:54.197113 (+1054464us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:26:54.432612 (+235499us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8471296}
W20260709 12:26:54.549053  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 94914.9us
I20260709 12:26:54.534135  7637 raft_consensus.cc:740] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:54.525465  7716 raft_consensus.cc:3060] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:54.558588  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 71592.8us
I20260709 12:26:54.561334  7205 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:54.562961  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:54.526194  7632 consensus_queue.cc:1059] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:26:54.546821  7709 raft_consensus.cc:2749] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.547240  7668 raft_consensus.cc:493] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.574848  7205 leader_election.cc:304] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:54.576026  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:54.576833  7164 raft_consensus.cc:2468] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:54.556224  7719 raft_consensus.cc:697] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:54.556437  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:54.579463  7164 raft_consensus.cc:1240] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:54.561187  7237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49160 (request call id 70) took 1165 ms. Trace:
I20260709 12:26:54.580502  7670 raft_consensus.cc:2749] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.590603  7164 raft_consensus.cc:1240] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:54.573882  7631 raft_consensus.cc:2749] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:26:54.586028  7717 log.cc:927] Time spent T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:26:54.592037  7725 log.cc:927] Time spent T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 12:26:54.596447  7649 consensus_meta.cc:287] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.006s
I20260709 12:26:54.582171  7054 leader_election.cc:304] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:54.607487  7284 tablet_bootstrap.cc:492] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:54.582438  7668 raft_consensus.cc:515] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:54.598366  7083 raft_consensus.cc:1240] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:54.609112  7284 ts_tablet_manager.cc:1403] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.474s	user 0.031s	sys 0.035s
I20260709 12:26:54.598696  7156 raft_consensus.cc:3060] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.626302  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:26:54.627414  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.623034  6914 catalog_manager.cc:5697] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.631703  7641 raft_consensus.cc:3055] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:54.632323  7641 raft_consensus.cc:740] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:54.633637  7641 consensus_queue.cc:260] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:54.661644  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:54.662778  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:54.663512  7231 raft_consensus.cc:1240] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:54.465337  7718 consensus_queue.cc:1175] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" responder_term: 2 status { last_received { term: 0 index: 0 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:26:54.664108  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:54.665453  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:54.666977  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:54.603266  7637 consensus_queue.cc:260] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:54.642894  7640 raft_consensus.cc:2749] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.668357  7711 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:54.673440  7637 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.679425  7160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56782 (request call id 59) took 1459 ms. Trace:
I20260709 12:26:54.671500  7016 raft_consensus.cc:2468] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:26:54.679875  7160 rpcz_store.cc:276] 0709 12:26:53.219588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.987948 (+768360us) service_pool.cc:224] Handling call
0709 12:26:53.988279 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:54.015013 (+ 26734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.679142 (+664129us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b540017e6a0. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f287818bdc0 00007f2878217a02 00007f2878213dd6 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2
0709 12:26:54.679358 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5834624}
I20260709 12:26:54.682783  7165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56782 (request call id 64) took 1398 ms. Trace:
I20260709 12:26:54.683290  7165 rpcz_store.cc:276] 0709 12:26:53.293557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.336369 (+ 42812us) service_pool.cc:224] Handling call
0709 12:26:54.682565 (+1346196us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54001a2a54. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:26:54.682717 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1098466048}
I20260709 12:26:54.585759  7237 rpcz_store.cc:276] 0709 12:26:53.392543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.423397 (+ 30854us) service_pool.cc:224] Handling call
0709 12:26:54.514627 (+1091230us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b5800010298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:26:54.514857 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:54.533987 (+ 19130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.557709 (+ 23722us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10091392}
I20260709 12:26:54.668283  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:54.686607  7284 raft_consensus.cc:359] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:54.611850  7649 raft_consensus.cc:515] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:54.692334  7284 raft_consensus.cc:385] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.694281  7284 raft_consensus.cc:740] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.695874  7128 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:54.635178  7641 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:54.675071  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 108375us
I20260709 12:26:54.685542  7668 leader_election.cc:290] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:54.701637  7128 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:54.703382  7284 consensus_queue.cc:260] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:54.706267  7680 raft_consensus.cc:2749] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.706425  7011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 120) took 1467 ms. Trace:
I20260709 12:26:54.707134  7157 raft_consensus.cc:1240] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:54.707785  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:54.708434  7086 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.709172  7633 raft_consensus.cc:3055] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:54.709606  7633 raft_consensus.cc:740] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:54.710398  7633 consensus_queue.cc:260] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:54.711483  7284 ts_tablet_manager.cc:1434] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.099s	user 0.007s	sys 0.000s
I20260709 12:26:54.711568  7633 raft_consensus.cc:3060] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.699450  7650 raft_consensus.cc:2749] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.714564  7632 raft_consensus.cc:493] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:54.715123  7632 raft_consensus.cc:515] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:54.706941  7011 rpcz_store.cc:276] 0709 12:26:53.238391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.268907 (+ 30516us) service_pool.cc:224] Handling call
0709 12:26:53.287141 (+ 18234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:53.574119 (+286978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.695285 (+1121166us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54003d5254. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:26:54.705257 (+  9972us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620540800}
I20260709 12:26:54.719648  7054 leader_election.cc:304] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:54.720710  7709 raft_consensus.cc:2749] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:54.721361  7713 log.cc:927] Time spent T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.478s	user 0.011s	sys 0.006s
I20260709 12:26:54.721650  7287 tablet_bootstrap.cc:492] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:54.721488  7054 leader_election.cc:304] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:54.723011  7054 leader_election.cc:304] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:54.671919  7642 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:26:54.688944  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 235153us
I20260709 12:26:54.612635  7719 consensus_queue.cc:237] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:54.726920  7709 raft_consensus.cc:2749] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.732236  7711 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:54.718086  7712 raft_consensus.cc:3055] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:54.735016  7284 tablet_bootstrap.cc:492] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:54.737701  7285 tablet_bootstrap.cc:492] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:54.733088  7640 raft_consensus.cc:2749] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:54.738459  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 158400us
I20260709 12:26:54.740361  7285 ts_tablet_manager.cc:1403] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.571s	user 0.017s	sys 0.030s
I20260709 12:26:54.739563  7712 raft_consensus.cc:740] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:26:54.752525  7205 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:54.755889  7084 raft_consensus.cc:3060] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:54.758719  7055 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.761847  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:54.756533  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:54.754707  7690 consensus_meta.cc:287] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.005s
I20260709 12:26:54.750315  7630 raft_consensus.cc:3055] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:54.756753  7723 consensus_queue.cc:1059] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:26:54.769659  7288 tablet_bootstrap.cc:492] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:54.773984  7288 ts_tablet_manager.cc:1403] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.621s	user 0.021s	sys 0.003s
I20260709 12:26:54.775964  7285 raft_consensus.cc:359] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:54.776527  7285 raft_consensus.cc:385] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.776850  7285 raft_consensus.cc:740] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.766914  7632 leader_election.cc:290] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:54.782022  7662 raft_consensus.cc:3055] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:54.782364  7712 consensus_queue.cc:260] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:54.783802  7712 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.791603  7157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56782 (request call id 66) took 1408 ms. Trace:
I20260709 12:26:54.792207  7157 rpcz_store.cc:276] 0709 12:26:53.424174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.997142 (+572968us) service_pool.cc:224] Handling call
0709 12:26:53.997434 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:54.707675 (+710241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.791299 (+ 83624us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b540042f754. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:26:54.791523 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1623010560}
I20260709 12:26:54.767987  7012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 132) took 1026 ms. Trace:
I20260709 12:26:54.793900  7086 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:26:54.794209  7012 rpcz_store.cc:276] 0709 12:26:53.741792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.743617 (+  1825us) service_pool.cc:224] Handling call
0709 12:26:54.763445 (+1019828us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b58001b0698. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:26:54.767419 (+  3974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:54.767616 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:54.767650 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:54.767703 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:54.767739 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.767806 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:54.767927 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6411136}
I20260709 12:26:54.801049  7285 consensus_queue.cc:260] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:54.802799  7285 ts_tablet_manager.cc:1434] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.000s
I20260709 12:26:54.803773  7285 tablet_bootstrap.cc:492] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:54.804742  7680 consensus_queue.cc:1059] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:54.782521  7662 raft_consensus.cc:740] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:54.805513  7159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56784 (request call id 51) took 1605 ms. Trace:
I20260709 12:26:54.806396  7662 consensus_queue.cc:260] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:54.800181  7288 raft_consensus.cc:359] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:54.814667  7288 raft_consensus.cc:385] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:54.808931  7129 leader_election.cc:304] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:26:54.817368  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.815285  7288 raft_consensus.cc:740] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.821398  7288 consensus_queue.cc:260] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:54.808167  7662 raft_consensus.cc:3060] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.754967  7054 leader_election.cc:304] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:54.771929  7665 raft_consensus.cc:493] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.828761  7704 raft_consensus.cc:2749] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:54.766737  7739 raft_consensus.cc:2749] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:54.831512  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:54.837026  7013 raft_consensus.cc:3060] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.773095  7630 raft_consensus.cc:740] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:54.833843  7233 raft_consensus.cc:1275] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:54.805979  7159 rpcz_store.cc:276] 0709 12:26:53.199915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.386336 (+186421us) service_pool.cc:224] Handling call
0709 12:26:53.386695 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:53.913967 (+527272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.805257 (+891290us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54007eb3d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:26:54.805429 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1079438208}
I20260709 12:26:54.774544  7690 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:26:54.840368  6979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.843464  7631 raft_consensus.cc:493] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.832538  7645 consensus_queue.cc:1059] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:26:54.877017  7645 raft_consensus.cc:3055] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:54.879132  7288 ts_tablet_manager.cc:1434] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.105s	user 0.007s	sys 0.001s
I20260709 12:26:54.831580  7716 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:26:54.856722  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 108499us
I20260709 12:26:54.839843  7665 raft_consensus.cc:515] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:54.891453  7287 tablet_bootstrap.cc:654] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.895474  7716 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:54.896248  7285 tablet_bootstrap.cc:654] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.896715  7054 leader_election.cc:304] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:26:54.898221  7690 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:54.878284  7631 raft_consensus.cc:515] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:54.899238  7284 tablet_bootstrap.cc:654] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.872512  7642 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:26:54.902510  7726 log.cc:927] Time spent T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.495s	user 0.003s	sys 0.002s
I20260709 12:26:54.906639  7091 raft_consensus.cc:1240] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:54.909664  7013 raft_consensus.cc:2468] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:26:54.911055  7706 leader_election.cc:290] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:54.912424  7665 leader_election.cc:290] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:54.884778  7010 raft_consensus.cc:1240] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:54.877441  7645 raft_consensus.cc:740] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
W20260709 12:26:54.922163  7054 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.924921  7288 tablet_bootstrap.cc:492] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:54.925627  7640 raft_consensus.cc:2804] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.968313  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:54.968806  7640 raft_consensus.cc:493] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.969226  7640 raft_consensus.cc:3060] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.969267  7009 raft_consensus.cc:2468] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:54.973238  7128 leader_election.cc:304] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:54.973974  7237 raft_consensus.cc:1275] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.974272  7128 leader_election.cc:304] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:54.974390  7645 consensus_queue.cc:260] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:54.975368  7665 raft_consensus.cc:2804] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:54.975817  7665 raft_consensus.cc:493] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.976409  7665 raft_consensus.cc:3060] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:54.975809  7288 tablet_bootstrap.cc:654] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:54.984722  7712 raft_consensus.cc:493] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:54.989007  7712 raft_consensus.cc:515] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:54.991575  7712 leader_election.cc:290] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:54.886117  7630 consensus_queue.cc:260] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:26:54.985710  7694 log.cc:927] Time spent T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:26:54.976013  7706 raft_consensus.cc:2804] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:54.925657  7641 consensus_queue.cc:1048] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.063s
I20260709 12:26:54.975809  7645 raft_consensus.cc:3060] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.998195  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:54.987721  7642 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:55.003768  7649 leader_election.cc:290] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:55.006261  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:54.984767  7632 raft_consensus.cc:2804] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:55.011593  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:55.022220  7091 raft_consensus.cc:2393] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 1: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:26:55.003202  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:55.019038  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 210988us
I20260709 12:26:55.008721  7706 raft_consensus.cc:697] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
W20260709 12:26:55.026846  6982 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.987709  7680 consensus_queue.cc:1059] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:26:55.030228  7088 raft_consensus.cc:2393] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 1: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:26:55.030921  7706 consensus_queue.cc:237] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:55.019028  7630 raft_consensus.cc:3060] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:55.121644  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:55.121748  6982 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.027561  7633 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.140935  7091 raft_consensus.cc:1275] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:55.019595  7642 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:55.127076  7647 raft_consensus.cc:493] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:55.183203  7128 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.132117  7637 raft_consensus.cc:493] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.038275  7688 consensus_queue.cc:1048] T 6eb05e220cae466b9a2ef8f7d1565609 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.109s
I20260709 12:26:55.144503  7633 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:55.147130  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:55.207470  6980 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:55.218010  7089 raft_consensus.cc:2393] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 2: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:26:55.214941  7641 raft_consensus.cc:493] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.219318  7641 raft_consensus.cc:515] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:55.221915  7641 leader_election.cc:290] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:26:55.222430  7747 log.cc:927] Time spent T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 12:26:55.202409  7637 raft_consensus.cc:515] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:26:55.224848  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:26:55.229213  7743 log.cc:927] Time spent T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
I20260709 12:26:55.231478  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:55.231950  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:55.233495  7090 raft_consensus.cc:1275] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:26:55.234025  7090 pending_rounds.cc:85] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca: Aborting all ops after (but not including) 0
I20260709 12:26:55.233345  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:55.234292  7090 pending_rounds.cc:107] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:26:55.234661  7090 raft_consensus.cc:2889] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:55.238068  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:55.240823  7727 raft_consensus.cc:2804] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:55.239225  7083 raft_consensus.cc:1240] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:55.241345  7727 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:55.241794  7727 raft_consensus.cc:3060] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.240726  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:55.245204  7637 leader_election.cc:290] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:55.246279  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:55.248413  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 54810.6us
I20260709 12:26:55.251423  7131 leader_election.cc:304] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:55.253603  7665 raft_consensus.cc:515] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:55.201784  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:55.212958  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:26:55.313651  6979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.312774  7631 leader_election.cc:290] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:55.320248  7650 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.202096  7647 raft_consensus.cc:515] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:55.343729  6982 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:55.327370  7640 raft_consensus.cc:515] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:55.344937  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:55.346450  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:55.346725  7640 leader_election.cc:290] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:55.347126  7014 raft_consensus.cc:2468] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:26:55.348186  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:55.349732  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:55.350329  7007 raft_consensus.cc:2468] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:55.325086  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:55.332974  7733 raft_consensus.cc:493] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.351550  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:55.352192  7014 raft_consensus.cc:3060] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.352011  7733 raft_consensus.cc:515] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:55.354453  7733 leader_election.cc:290] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:55.331130  7086 raft_consensus.cc:3060] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.355343  7082 raft_consensus.cc:2393] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 1: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:26:55.355978  7712 raft_consensus.cc:493] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.356487  7712 raft_consensus.cc:515] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:55.358472  7712 leader_election.cc:290] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:55.358515  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:55.361953  7128 leader_election.cc:304] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:55.362841  7007 raft_consensus.cc:1275] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:55.363400  7008 raft_consensus.cc:1240] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:26:55.346771  7723 raft_consensus.cc:2749] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.342526  7650 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:55.365873  7649 raft_consensus.cc:3055] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:55.366312  7649 raft_consensus.cc:740] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:55.366576  7014 raft_consensus.cc:2468] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:55.366969  7650 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:55.367211  7649 consensus_queue.cc:260] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:55.368283  7649 raft_consensus.cc:3060] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.369303  7633 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:55.370580  7084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 107) took 1211 ms. Trace:
W20260709 12:26:55.372136  7205 leader_election.cc:343] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.376174  7727 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:26:55.326869  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 75537.4us
I20260709 12:26:55.396651  7564 consensus_queue.cc:1048] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:55.384967  7665 leader_election.cc:290] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:26:55.386039  7749 log.cc:927] Time spent T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:26:55.389919  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 46283.4us
W20260709 12:26:55.391120  7129 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.363399  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:55.395437  7205 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:55.373453  7012 raft_consensus.cc:1275] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:55.384994  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:55.383764  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:55.388800  7641 raft_consensus.cc:2804] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:55.397262  7128 leader_election.cc:304] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:55.389287  7652 raft_consensus.cc:3055] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:55.409796  6982 leader_election.cc:304] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:55.415678  7644 raft_consensus.cc:2804] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:26:55.409293  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 201933us
W20260709 12:26:55.423961  6982 leader_election.cc:343] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.424604  6982 leader_election.cc:304] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:55.406662  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:55.409001  7633 raft_consensus.cc:2804] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:26:55.427549  6982 leader_election.cc:343] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.430598  7164 raft_consensus.cc:1275] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:55.400828  7716 consensus_queue.cc:1059] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:26:55.413203  7641 raft_consensus.cc:493] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.404428  7692 consensus_queue.cc:1048] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:26:55.410396  7090 raft_consensus.cc:2468] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:55.417706  7652 raft_consensus.cc:740] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:55.410894  7733 consensus_queue.cc:1059] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:26:55.422465  7642 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:55.419387  7644 raft_consensus.cc:697] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:55.436090  7158 raft_consensus.cc:2393] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 2: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:26:55.426590  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:55.457255  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:55.419229  7688 consensus_queue.cc:1048] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:26:55.431310  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:55.455935  7662 consensus_queue.cc:1059] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:26:55.473789  7704 raft_consensus.cc:2749] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:55.474081  7632 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:55.474661  7632 raft_consensus.cc:3060] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.475025  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:55.473872  7231 raft_consensus.cc:2468] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:26:55.475765  7086 raft_consensus.cc:2468] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:26:55.476766  7089 raft_consensus.cc:1275] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:55.477787  7727 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:55.477975  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:55.478869  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:55.479328  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:55.480096  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:55.420092  7131 leader_election.cc:304] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:55.437083  7723 raft_consensus.cc:2749] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.439373  7641 raft_consensus.cc:3060] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.436081  7637 raft_consensus.cc:2749] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:26:55.551344  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 142147us
I20260709 12:26:55.552598  7131 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:55.469833  7754 consensus_queue.cc:1059] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:55.554807  7754 raft_consensus.cc:3055] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:55.555217  7754 raft_consensus.cc:740] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:55.481182  7652 consensus_queue.cc:260] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:55.557001  7652 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.476792  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:55.560667  7727 consensus_queue.cc:1175] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:26:55.560987  7086 raft_consensus.cc:2468] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:26:55.440615  7633 raft_consensus.cc:697] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
W20260709 12:26:55.482653  7202 leader_election.cc:343] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.461926  7164 raft_consensus.cc:2468] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:26:55.483024  7716 consensus_queue.cc:1048] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:26:55.484257  7284 tablet_bootstrap.cc:492] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:55.394822  7084 rpcz_store.cc:276] 0709 12:26:54.159236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.165797 (+  6561us) service_pool.cc:224] Handling call
0709 12:26:54.754548 (+588751us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:26:54.755728 (+  1180us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:54.901494 (+145766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:54.901530 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:54.902040 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 12:26:55.322986 (+420946us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:55.369883 (+ 46897us) log.cc:844] Serialized 14 byte log entry
0709 12:26:55.370132 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.370215 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:55.370255 (+    40us) raft_consensus.cc:1685] finished
0709 12:26:55.370357 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:55.370497 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44899,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":16745,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":3362,"spinlock_wait_cycles":9552640,"thread_start_us":356228,"threads_started":1,"wal-append.queue_time_us":446613}
I20260709 12:26:55.485138  7158 raft_consensus.cc:1240] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:26:55.486555  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:55.487666  7288 tablet_bootstrap.cc:492] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:55.488749  7644 consensus_queue.cc:237] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:55.490540  7719 raft_consensus.cc:3055] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:55.576201  7719 raft_consensus.cc:740] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:55.437449  7083 raft_consensus.cc:2468] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:26:55.441917  7707 raft_consensus.cc:493] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:55.431519  7752 consensus_queue.cc:1048] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.065s
I20260709 12:26:55.577188  7707 raft_consensus.cc:515] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:55.579380  7707 leader_election.cc:290] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:55.440565  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:55.579569  7633 consensus_queue.cc:237] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:55.580093  7232 raft_consensus.cc:2468] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:26:55.476480  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:55.570422  7202 leader_election.cc:304] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:55.491842  7632 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:26:55.582695  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 117902us
I20260709 12:26:55.583917  7632 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:55.493325  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:55.494158  7205 leader_election.cc:304] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:55.495896  7287 tablet_bootstrap.cc:492] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:55.480111  7647 leader_election.cc:290] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:55.502972  7087 raft_consensus.cc:1240] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:26:55.502671  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:55.503878  7054 leader_election.cc:304] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:55.505213  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:55.505717  7013 raft_consensus.cc:1240] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:55.507019  7640 raft_consensus.cc:3055] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:55.508368  7091 raft_consensus.cc:1275] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:55.509801  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:55.511416  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:55.513182  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:55.593119  7157 raft_consensus.cc:1240] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:55.587823  7632 raft_consensus.cc:2804] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:55.516132  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:55.518983  7129 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:26:55.598316  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 79417.1us
I20260709 12:26:55.518888  7702 consensus_queue.cc:1048] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:26:55.482779  7285 tablet_bootstrap.cc:492] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
W20260709 12:26:55.528020  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 71292.2us
I20260709 12:26:55.536813  7016 raft_consensus.cc:1240] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:55.537518  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:55.543401  6982 leader_election.cc:304] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:26:55.543990  7203 leader_election.cc:343] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.604597  7203 leader_election.cc:304] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
W20260709 12:26:55.605567  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 61613.5us
I20260709 12:26:55.607204  7203 leader_election.cc:304] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:55.546969  7755 raft_consensus.cc:3055] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:55.547855  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:55.568050  7284 ts_tablet_manager.cc:1403] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.837s	user 0.011s	sys 0.008s
I20260709 12:26:55.568184  7055 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
W20260709 12:26:55.617786  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 49723.2us
I20260709 12:26:55.574239  7288 ts_tablet_manager.cc:1403] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.650s	user 0.014s	sys 0.013s
I20260709 12:26:55.585639  7287 ts_tablet_manager.cc:1403] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.864s	user 0.016s	sys 0.008s
W20260709 12:26:55.585736  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 91671.4us
W20260709 12:26:55.586090  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 82301.9us
I20260709 12:26:55.621420  7054 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:55.565039  7688 raft_consensus.cc:2749] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.571305  7630 raft_consensus.cc:2749] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.556015  7754 consensus_queue.cc:260] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:55.584723  7733 raft_consensus.cc:2749] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:55.600483  7285 ts_tablet_manager.cc:1403] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.797s	user 0.015s	sys 0.004s
I20260709 12:26:55.587467  7645 raft_consensus.cc:2804] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:55.602500  7014 raft_consensus.cc:2393] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 1: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:26:55.595783  7632 raft_consensus.cc:493] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:55.634513  7645 raft_consensus.cc:493] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.636900  7632 raft_consensus.cc:3060] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.637171  7645 raft_consensus.cc:3060] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.638367  7284 raft_consensus.cc:359] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:55.639336  7284 raft_consensus.cc:385] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.639671  7284 raft_consensus.cc:740] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.588305  7640 raft_consensus.cc:740] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:26:55.611153  7739 raft_consensus.cc:2749] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:55.609022  7755 raft_consensus.cc:740] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
W20260709 12:26:55.614205  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 70898.2us
I20260709 12:26:55.650800  6982 leader_election.cc:304] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:55.650753  7288 raft_consensus.cc:359] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:55.614442  7752 raft_consensus.cc:2749] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.651592  7288 raft_consensus.cc:385] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.611306  7012 raft_consensus.cc:1275] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:55.588955  7009 raft_consensus.cc:2468] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:55.653733  6982 leader_election.cc:304] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:55.624243  6980 leader_election.cc:304] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:26:55.625444  7203 consensus_peers.cc:597] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 -> Peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Couldn't send request to peer 022925662268440c91fff7e8732d7a0b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:55.626281  7716 raft_consensus.cc:2804] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:55.631165  7688 consensus_queue.cc:1048] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:55.605213  7649 raft_consensus.cc:2804] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:55.617218  7673 raft_consensus.cc:2749] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.640523  7284 consensus_queue.cc:260] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:55.654583  7285 raft_consensus.cc:359] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:55.661405  7285 raft_consensus.cc:385] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.661778  7285 raft_consensus.cc:740] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.645659  6913 catalog_manager.cc:5697] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b reported cstate change: term changed from 1 to 2, leader changed from 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66) to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 2 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.632104  7718 raft_consensus.cc:2749] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.657303  6982 leader_election.cc:304] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:55.651916  7288 raft_consensus.cc:740] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.658703  6914 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48270 (request call id 70) took 2378 ms. Trace:
I20260709 12:26:55.666455  7288 consensus_queue.cc:260] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:55.670732  6982 leader_election.cc:304] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:55.671919  6982 leader_election.cc:304] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:55.627321  7528 consensus_queue.cc:1048] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 12:26:55.675943  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:55.655970  7707 raft_consensus.cc:2749] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.676865  6982 leader_election.cc:304] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:55.658481  7727 raft_consensus.cc:2749] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.656253  7716 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:55.684656  7285 consensus_queue.cc:260] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:55.658802  7723 raft_consensus.cc:2804] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:55.689376  6982 leader_election.cc:304] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:55.659979  7649 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.683684  7287 raft_consensus.cc:359] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:55.695379  7287 raft_consensus.cc:385] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:55.695819  7287 raft_consensus.cc:740] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.680799  7637 raft_consensus.cc:2749] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.665791  7754 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.623507  7719 consensus_queue.cc:260] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:55.699277  7287 consensus_queue.cc:260] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:55.681180  7752 raft_consensus.cc:2749] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.693025  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:55.693143  7755 consensus_queue.cc:260] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:55.641206  7640 consensus_queue.cc:260] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:55.712103  7752 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:55.720736  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:55.721706  7239 raft_consensus.cc:2393] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 1: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:26:55.721179  7752 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:55.698925  7649 raft_consensus.cc:3060] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:55.692889  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:55.711313  7284 ts_tablet_manager.cc:1434] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.002s
I20260709 12:26:55.709021  7637 raft_consensus.cc:493] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.698957  7723 raft_consensus.cc:493] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.715188  7719 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.666170  6914 rpcz_store.cc:276] 0709 12:26:53.283978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.288047 (+  4069us) service_pool.cc:224] Handling call
0709 12:26:55.655232 (+2367185us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:54.758147 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:54.760688 (+  2541us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:54.760725 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:26:54.760741 (+    16us) tablet.cc:662] Decoding operations
0709 12:26:54.761060 (+   319us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:54.761131 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:54.761162 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:54.761346 (+   184us) tablet.cc:701] Row locks acquired
0709 12:26:54.761362 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:26:54.761496 (+   134us) write_op.cc:270] Start()
0709 12:26:54.761603 (+   107us) write_op.cc:276] Timestamp: P: 1783600014761453 usec, L: 0
0709 12:26:54.761625 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:26:54.762265 (+   640us) log.cc:844] Serialized 537 byte log entry
0709 12:26:55.470147 (+707882us) op_driver.cc:464] REPLICATION: finished
0709 12:26:55.541141 (+ 70994us) write_op.cc:301] APPLY: starting
0709 12:26:55.541228 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:55.541332 (+   104us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:55.541453 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:55.575812 (+ 34359us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:55.583146 (+  7334us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:55.583212 (+    66us) write_op.cc:312] APPLY: finished
0709 12:26:55.583655 (+   443us) log.cc:844] Serialized 22 byte log entry
0709 12:26:55.588235 (+  4580us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:55.591564 (+  3329us) write_op.cc:454] Released schema lock
0709 12:26:55.596702 (+  5138us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:55.602982 (+  6280us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:55.603020 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":70689,"apply.run_cpu_time_us":2409,"apply.run_wall_time_us":61802,"num_ops":1,"prepare.queue_time_us":113639,"prepare.run_cpu_time_us":67414,"prepare.run_wall_time_us":131754,"raft.queue_time_us":239584,"raft.run_cpu_time_us":14303,"raft.run_wall_time_us":70959,"replication_time_us":708375,"thread_start_us":424558,"threads_started":4,"wal-append.queue_time_us":203820}]]}
I20260709 12:26:55.717981  7287 ts_tablet_manager.cc:1434] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.098s	user 0.004s	sys 0.003s
I20260709 12:26:55.704236  7707 raft_consensus.cc:2749] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.683005  7767 raft_consensus.cc:2749] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.690411  7662 raft_consensus.cc:2749] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.723110  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:55.699856  7716 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.729569  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:55.729902  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:55.695303  7733 consensus_queue.cc:1059] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:26:55.745918  7234 raft_consensus.cc:2393] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 2: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:26:55.693717  7718 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:55.746843  7718 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:26:55.747432  7773 log.cc:927] Time spent T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:26:55.707723  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:55.732415  7239 raft_consensus.cc:1275] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:55.719218  7755 raft_consensus.cc:3060] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.740314  7285 ts_tablet_manager.cc:1434] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.108s	user 0.006s	sys 0.002s
I20260709 12:26:55.700788  7131 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:55.743384  7284 tablet_bootstrap.cc:492] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
W20260709 12:26:55.724133  7631 consensus_queue.cc:1175] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "022925662268440c91fff7e8732d7a0b" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:26:55.734949  7637 raft_consensus.cc:515] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:26:55.759925  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 77735.7us
I20260709 12:26:55.753245  7632 raft_consensus.cc:515] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:26:55.760726  7131 leader_election.cc:343] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.761741  7637 leader_election.cc:290] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:55.702665  7769 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.742691  7287 tablet_bootstrap.cc:492] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:55.749171  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:26:55.750995  7772 log.cc:927] Time spent T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:26:55.751830  7688 raft_consensus.cc:493] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:55.768229  7774 log.cc:927] Time spent T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:26:55.767971  7688 raft_consensus.cc:515] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:55.769241  7160 raft_consensus.cc:1275] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:55.769898  7718 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:26:55.769968  7776 log.cc:927] Time spent T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:26:55.770126  7688 leader_election.cc:290] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:55.752974  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:55.733346  7723 raft_consensus.cc:3060] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:55.757781  7055 leader_election.cc:304] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:55.758738  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:55.753459  7649 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:55.761750  7131 leader_election.cc:304] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:55.776916  7055 leader_election.cc:304] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:55.784992  7632 leader_election.cc:290] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:55.785276  7633 raft_consensus.cc:3055] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:55.785725  7633 raft_consensus.cc:740] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:55.786506  7633 consensus_queue.cc:260] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:55.787655  7633 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.788172  7649 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:55.788807  7649 raft_consensus.cc:2804] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:55.788846  7706 consensus_queue.cc:1048] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:55.789384  7649 raft_consensus.cc:697] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:55.789229  7233 raft_consensus.cc:2393] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 2: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:26:55.726423  7752 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:55.736763  7641 raft_consensus.cc:515] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:55.792111  7285 tablet_bootstrap.cc:492] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:55.792142  7055 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:55.771288  7665 raft_consensus.cc:2749] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.799422  7649 consensus_queue.cc:237] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:55.791431  7718 raft_consensus.cc:2749] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.791589  7645 raft_consensus.cc:515] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:55.847195  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:55.847879  7231 raft_consensus.cc:3060] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:55.849575  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:55.800267  7690 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:55.852880  7129 leader_election.cc:343] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.853165  7690 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:55.856179  7690 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:55.856964  7690 raft_consensus.cc:2749] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.801712  7642 consensus_queue.cc:1048] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:26:55.797452  7632 raft_consensus.cc:2749] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:55.847142  7645 leader_election.cc:290] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:55.804679  7528 consensus_queue.cc:1048] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:26:55.875643  7238 raft_consensus.cc:2393] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 1: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:26:55.847244  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:55.873468  7159 raft_consensus.cc:2393] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 1: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:26:55.889613  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:26:55.881764  7743 log.cc:927] Time spent T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:26:55.772706  7769 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:55.887403  7641 leader_election.cc:290] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:55.897826  7160 raft_consensus.cc:1240] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:55.897502  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:55.924213  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:55.951226  7284 tablet_bootstrap.cc:654] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:55.929747  7090 raft_consensus.cc:2393] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 1: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
W20260709 12:26:55.969599  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 299583us
W20260709 12:26:55.979269  7205 leader_election.cc:343] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:55.983876  7205 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
W20260709 12:26:55.991868  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 302538us
I20260709 12:26:55.992858  6982 leader_election.cc:304] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:26:55.988734  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 196655us
W20260709 12:26:55.969163  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 299565us
I20260709 12:26:56.008721  7780 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.009315  7780 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.011798  7780 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:56.016001  7285 tablet_bootstrap.cc:654] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:56.016427  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.016777  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:56.017728  7156 raft_consensus.cc:2393] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 2: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:26:55.984395  7719 consensus_queue.cc:1048] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 12:26:56.004493  7645 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.033545  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:56.035501  7288 ts_tablet_manager.cc:1434] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.416s	user 0.024s	sys 0.032s
I20260709 12:26:56.037395  7288 tablet_bootstrap.cc:492] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:56.046597  7287 tablet_bootstrap.cc:654] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.048475  7288 tablet_bootstrap.cc:654] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.049922  7239 raft_consensus.cc:2468] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:26:56.037590  7645 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:56.030694  7670 raft_consensus.cc:2804] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:56.055550  7645 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:56.056734  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:56.058995  7769 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:56.024325  7716 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:56.071568  7670 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:56.082293  7670 raft_consensus.cc:3060] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:56.106683  7235 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
W20260709 12:26:56.166852  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 173850us
W20260709 12:26:56.168993  6982 leader_election.cc:343] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.170359  6980 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:26:56.171931  6980 leader_election.cc:343] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.172475  6980 leader_election.cc:304] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:56.174698  6980 leader_election.cc:304] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:56.177342  6980 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:26:56.183071  7057 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:56.183737  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 144333us
W20260709 12:26:56.190687  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 194810us
I20260709 12:26:56.180588  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:56.203948  7690 raft_consensus.cc:493] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:56.209043  7712 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:56.210582  7716 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:56.211782  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:56.212193  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:56.212255  7284 tablet_bootstrap.cc:492] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:56.213124  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:56.223184  7644 consensus_queue.cc:1048] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:55.987903  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:56.227787  6980 leader_election.cc:343] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.214141  7645 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.229378  7645 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:56.234104  7288 tablet_bootstrap.cc:492] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
W20260709 12:26:56.213584  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.210623  7647 raft_consensus.cc:2749] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:56.219434  7727 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.220952  7012 raft_consensus.cc:3060] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.224066  7285 tablet_bootstrap.cc:492] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
W20260709 12:26:56.187927  7202 leader_election.cc:343] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.246578  7754 raft_consensus.cc:2804] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:56.247151  7754 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:56.247383  7707 raft_consensus.cc:2749] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:56.247572  7754 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:56.248374  7707 raft_consensus.cc:2749] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:56.250432  7662 raft_consensus.cc:2749] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:56.253069  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:56.253252  7712 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:56.254062  7016 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:26:56.255543  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:56.255834  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:56.256068  7712 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:56.256716  7013 raft_consensus.cc:2368] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2.
I20260709 12:26:56.256980  7230 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:26:56.259536  6980 leader_election.cc:304] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:56.261008  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
W20260709 12:26:56.264022  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 68407.7us
I20260709 12:26:56.268414  7054 leader_election.cc:304] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:56.268885  7284 ts_tablet_manager.cc:1403] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.535s	user 0.020s	sys 0.013s
I20260709 12:26:56.266033  7285 ts_tablet_manager.cc:1403] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.494s	user 0.028s	sys 0.017s
I20260709 12:26:56.269443  7716 consensus_queue.cc:1059] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:26:56.236505  7727 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.285535  7645 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:56.289299  7752 raft_consensus.cc:2749] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:56.290247  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:56.293263  7230 raft_consensus.cc:2393] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 2: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
W20260709 12:26:56.294519  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 56027.2us
I20260709 12:26:56.294773  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:56.301558  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:56.301658  7712 consensus_queue.cc:1059] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:56.306493  7727 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:56.307350  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:56.308254  7083 raft_consensus.cc:3060] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.308737  7288 ts_tablet_manager.cc:1403] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.272s	user 0.018s	sys 0.012s
I20260709 12:26:56.307790  7690 raft_consensus.cc:515] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.315157  7727 raft_consensus.cc:493] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.316021  7727 raft_consensus.cc:515] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.318866  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:56.319578  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:56.320251  7288 raft_consensus.cc:359] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:56.321101  7288 raft_consensus.cc:385] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.321390  7288 raft_consensus.cc:740] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.322104  7284 raft_consensus.cc:359] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.322190  7288 consensus_queue.cc:260] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:56.323135  7284 raft_consensus.cc:385] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.319625  7727 leader_election.cc:290] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:56.323503  7284 raft_consensus.cc:740] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.322592  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:56.328092  7723 consensus_meta.cc:287] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 0.532s	user 0.003s	sys 0.019s
I20260709 12:26:56.333587  7288 ts_tablet_manager.cc:1434] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.001s
I20260709 12:26:56.335331  7288 tablet_bootstrap.cc:492] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:56.335220  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:56.324353  7284 consensus_queue.cc:260] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.341646  7287 tablet_bootstrap.cc:492] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:56.342634  7287 ts_tablet_manager.cc:1403] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.608s	user 0.020s	sys 0.007s
I20260709 12:26:56.342700  7089 raft_consensus.cc:1275] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:56.346093  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:56.347482  7160 raft_consensus.cc:2368] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2.
I20260709 12:26:56.349447  7085 raft_consensus.cc:1240] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:56.353478  7288 tablet_bootstrap.cc:654] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.355438  7055 leader_election.cc:304] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:56.304359  6980 leader_election.cc:304] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:56.365347  7640 raft_consensus.cc:3060] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:56.281258  7202 leader_election.cc:304] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:56.372893  7690 leader_election.cc:290] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:56.373528  7083 raft_consensus.cc:2468] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:56.387730  7716 raft_consensus.cc:2749] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:26:56.387858  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 92040us
I20260709 12:26:56.396513  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:56.397063  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:56.398056  7235 raft_consensus.cc:2393] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 3: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:26:56.398193  6980 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:26:56.398545  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 130411us
I20260709 12:26:56.399060  7752 raft_consensus.cc:2804] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:26:56.399231  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 43930.4us
I20260709 12:26:56.399514  7752 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.399578  7054 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:56.399989  7752 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:56.405788  7718 raft_consensus.cc:2749] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:56.406891  7642 raft_consensus.cc:2804] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:56.407374  7642 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:56.407729  7642 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:56.409248  7789 raft_consensus.cc:3055] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:56.409734  7789 raft_consensus.cc:740] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:26:56.398082  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:56.336063  7723 raft_consensus.cc:515] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.416713  7285 raft_consensus.cc:359] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:56.425828  7285 raft_consensus.cc:385] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.426245  7285 raft_consensus.cc:740] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.428653  7284 ts_tablet_manager.cc:1434] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.151s	user 0.005s	sys 0.004s
I20260709 12:26:56.410692  7159 raft_consensus.cc:2468] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:26:56.409941  7670 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:56.457173  7285 consensus_queue.cc:260] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:56.443480  7054 leader_election.cc:400] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Vote denied by peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921) with higher term. Message: Invalid argument: T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2.
I20260709 12:26:56.462080  7054 leader_election.cc:403] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:56.450212  7233 raft_consensus.cc:2468] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:26:56.463600  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:56.466547  7788 raft_consensus.cc:493] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:56.467533  7788 raft_consensus.cc:515] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:56.468546  7008 raft_consensus.cc:2468] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:26:56.470715  7788 leader_election.cc:290] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:26:56.471549  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 226104us
I20260709 12:26:56.482527  7239 raft_consensus.cc:2393] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 2: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:26:56.485313  7055 leader_election.cc:400] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Vote denied by peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437) with higher term. Message: Invalid argument: T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2.
I20260709 12:26:56.488785  7670 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:26:56.490662  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 89077.8us
I20260709 12:26:56.491528  7054 leader_election.cc:304] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:56.493050  7054 leader_election.cc:304] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:56.414721  7789 consensus_queue.cc:260] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:56.494529  7789 raft_consensus.cc:3060] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:56.495393  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:56.496762  7680 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:56.496941  7287 raft_consensus.cc:359] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.497767  7287 raft_consensus.cc:385] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.498090  7287 raft_consensus.cc:740] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
W20260709 12:26:56.476894  7231 consensus_meta.cc:287] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.015s
I20260709 12:26:56.496349  7158 raft_consensus.cc:2468] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:26:56.497545  7680 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:56.516574  7287 consensus_queue.cc:260] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.525374  7640 raft_consensus.cc:2804] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:56.526026  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:56.526580  7680 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:56.509336  6910 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48276 (request call id 66) took 2338 ms. Trace:
I20260709 12:26:56.511587  7690 raft_consensus.cc:2749] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:56.530903  7285 ts_tablet_manager.cc:1434] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.249s	user 0.007s	sys 0.004s
I20260709 12:26:56.509624  7778 raft_consensus.cc:2749] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:56.512907  7716 raft_consensus.cc:3060] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 2
W20260709 12:26:56.515755  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 328042us
W20260709 12:26:56.543622  7205 leader_election.cc:343] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.526070  7640 raft_consensus.cc:697] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:26:56.520403  7231 raft_consensus.cc:2468] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
W20260709 12:26:56.545190  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 63435.8us
I20260709 12:26:56.553791  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:56.554912  7235 raft_consensus.cc:1240] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:56.558269  7723 leader_election.cc:290] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:56.560731  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:56.564971  7233 raft_consensus.cc:1240] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:56.544036  7012 raft_consensus.cc:2468] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:26:56.542936  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:56.528805  6910 rpcz_store.cc:276] 0709 12:26:54.176663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.176879 (+   216us) service_pool.cc:224] Handling call
0709 12:26:56.504851 (+2327972us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39493,"reported_tablets":2}
I20260709 12:26:56.570188  7284 tablet_bootstrap.cc:492] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:56.574302  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:56.568583  7727 raft_consensus.cc:2749] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:56.577512  7287 ts_tablet_manager.cc:1434] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.235s	user 0.009s	sys 0.002s
I20260709 12:26:56.577035  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:56.576406  7205 leader_election.cc:304] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:56.580956  7631 consensus_queue.cc:1059] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:26:56.580235  7640 consensus_queue.cc:237] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.590276  7723 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:56.596637  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 174569us
I20260709 12:26:56.594715  7723 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.598173  7762 raft_consensus.cc:2749] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:56.599897  7723 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:56.600908  7690 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:56.602952  7690 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.605400  7287 tablet_bootstrap.cc:492] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:56.607929  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:56.590195  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 333158us
I20260709 12:26:56.616411  7288 tablet_bootstrap.cc:492] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:56.616528  7089 raft_consensus.cc:1240] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:56.616997  7288 ts_tablet_manager.cc:1403] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.282s	user 0.017s	sys 0.030s
I20260709 12:26:56.620249  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:56.620970  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 51304.2us
I20260709 12:26:56.621016  7090 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:26:56.623510  7782 consensus_queue.cc:1048] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:56.624037  7205 leader_election.cc:304] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:56.601511  7644 consensus_queue.cc:1048] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:26:56.629029  7670 raft_consensus.cc:3055] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:56.629531  7670 raft_consensus.cc:740] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:56.631383  7285 tablet_bootstrap.cc:492] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:56.633316  7055 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:26:56.635174  7782 raft_consensus.cc:2804] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:56.646277  7009 raft_consensus.cc:1275] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:56.635619  7645 consensus_queue.cc:1059] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:56.637979  7633 raft_consensus.cc:493] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.640911  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:56.610502  7752 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.640276  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:56.643386  6913 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48280 (request call id 63) took 2417 ms. Trace:
I20260709 12:26:56.645299  7670 consensus_queue.cc:260] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:56.655999  7055 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:56.659400  6980 leader_election.cc:304] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:56.648530  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:56.676787  7789 raft_consensus.cc:2804] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:56.677134  7008 raft_consensus.cc:2468] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:56.660965  7088 raft_consensus.cc:2410] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:56.677969  6982 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:56.678927  7287 tablet_bootstrap.cc:654] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.679672  7727 raft_consensus.cc:2804] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:56.680101  7727 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.644343  7673 consensus_queue.cc:1048] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:26:56.680722  7727 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:56.681128  7789 raft_consensus.cc:697] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:26:56.646311  7782 raft_consensus.cc:697] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:56.682281  7789 consensus_queue.cc:237] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:56.682492  7782 consensus_queue.cc:237] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.652041  7089 raft_consensus.cc:2468] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:26:56.650760  7645 raft_consensus.cc:3055] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:56.686478  7645 raft_consensus.cc:740] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:56.687511  7645 consensus_queue.cc:260] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.688184  7723 consensus_queue.cc:1059] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:56.629050  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:56.688905  7645 raft_consensus.cc:3060] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:56.689283  7723 raft_consensus.cc:3055] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:56.689724  7723 raft_consensus.cc:740] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:56.650429  7633 raft_consensus.cc:515] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:56.690661  7723 consensus_queue.cc:260] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.691919  7723 raft_consensus.cc:3060] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:56.692698  7633 leader_election.cc:290] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:56.698336  7089 raft_consensus.cc:1275] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:56.699412  7727 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.663256  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:56.663724  7718 raft_consensus.cc:2804] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:56.701360  7718 raft_consensus.cc:697] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:26:56.701511  7015 raft_consensus.cc:2393] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 1: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:26:56.640517  7642 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.702461  7718 consensus_queue.cc:237] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:56.663920  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:56.704934  7642 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:56.705050  7090 raft_consensus.cc:2393] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 1: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
W20260709 12:26:56.706427  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 47138us
I20260709 12:26:56.664150  7129 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:56.665122  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:56.667825  7787 consensus_queue.cc:1048] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:56.652933  7752 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:56.670681  7690 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:56.670634  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:56.651818  7128 leader_election.cc:304] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:56.671387  7739 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.673275  7754 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:56.675563  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:56.675812  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:56.656754  6913 rpcz_store.cc:276] 0709 12:26:54.238183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.238319 (+   136us) service_pool.cc:224] Handling call
0709 12:26:56.643207 (+2404888us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:55.762505 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:55.785428 (+ 22923us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:55.785464 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:26:55.785482 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:55.785840 (+   358us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:55.785917 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:55.785951 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:55.786168 (+   217us) tablet.cc:701] Row locks acquired
0709 12:26:55.786185 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:26:55.786323 (+   138us) write_op.cc:270] Start()
0709 12:26:55.786427 (+   104us) write_op.cc:276] Timestamp: P: 1783600015786281 usec, L: 0
0709 12:26:55.786446 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:26:55.787141 (+   695us) log.cc:844] Serialized 537 byte log entry
0709 12:26:55.978496 (+191355us) op_driver.cc:464] REPLICATION: finished
0709 12:26:55.998540 (+ 20044us) write_op.cc:301] APPLY: starting
0709 12:26:56.005659 (+  7119us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:56.027646 (+ 21987us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:56.035153 (+  7507us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:56.052638 (+ 17485us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:56.077207 (+ 24569us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:56.079233 (+  2026us) write_op.cc:312] APPLY: finished
0709 12:26:56.092479 (+ 13246us) log.cc:844] Serialized 22 byte log entry
0709 12:26:56.097943 (+  5464us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:56.102972 (+  5029us) write_op.cc:454] Released schema lock
0709 12:26:56.103614 (+   642us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:56.107723 (+  4109us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:56.107750 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":68183,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":2821,"apply.run_cpu_time_us":2413,"apply.run_wall_time_us":109141,"num_ops":1,"prepare.queue_time_us":59658,"prepare.run_cpu_time_us":3009,"prepare.run_wall_time_us":49552,"replication_time_us":184402,"thread_start_us":16163,"threads_started":1}]]}
I20260709 12:26:56.707223  7647 raft_consensus.cc:2804] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:56.712903  7054 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:56.715382  7285 tablet_bootstrap.cc:654] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.716001  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
W20260709 12:26:56.716040  7205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:56.717218  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 53369.1us
I20260709 12:26:56.696458  7716 raft_consensus.cc:2749] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: Vote denied by peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921) with higher term. Message: Invalid argument: T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2.
W20260709 12:26:56.725536  7205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.719226  7647 raft_consensus.cc:493] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:56.728282  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 76621us
I20260709 12:26:56.710681  7085 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:26:56.824167  7630 raft_consensus.cc:2804] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:56.794601  7665 raft_consensus.cc:2804] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:26:56.796979  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:56.828619  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 161185us
I20260709 12:26:56.743220  7054 leader_election.cc:304] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:56.795254  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:56.741496  7727 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:56.811124  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:56.816821  7010 raft_consensus.cc:2393] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 2: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:26:56.817399  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:56.818385  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:56.748937  7007 raft_consensus.cc:1240] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:56.829591  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
W20260709 12:26:56.830320  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 87159.5us
I20260709 12:26:56.833294  7716 raft_consensus.cc:2749] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:56.719281  7633 raft_consensus.cc:493] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.741875  7647 raft_consensus.cc:3060] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.744254  7739 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.832325  7230 raft_consensus.cc:2393] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 3: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:26:56.803073  7631 raft_consensus.cc:493] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.795292  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:56.750003  7640 raft_consensus.cc:2749] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:56.847289  6982 leader_election.cc:343] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.853506  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
W20260709 12:26:56.885900  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 54349.7us
W20260709 12:26:56.832980  7131 leader_election.cc:343] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.840745  7630 raft_consensus.cc:697] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:56.838523  7665 raft_consensus.cc:697] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:56.908246  7809 raft_consensus.cc:493] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.849401  7633 raft_consensus.cc:515] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:56.908869  7809 raft_consensus.cc:515] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:56.910701  7288 raft_consensus.cc:359] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:56.916712  7288 raft_consensus.cc:385] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.849561  7231 raft_consensus.cc:2468] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
W20260709 12:26:56.915282  7205 leader_election.cc:343] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.917114  7288 raft_consensus.cc:740] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.894222  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:56.920253  7284 tablet_bootstrap.cc:654] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.851511  7631 raft_consensus.cc:515] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:56.920264  7015 raft_consensus.cc:2368] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4.
I20260709 12:26:56.906595  7235 raft_consensus.cc:2468] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
W20260709 12:26:56.933089  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 92345.9us
I20260709 12:26:56.935535  7202 leader_election.cc:304] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:56.906036  7680 consensus_queue.cc:1059] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:26:56.913024  7131 leader_election.cc:304] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:56.960494  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:56.961476  7012 raft_consensus.cc:2393] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 2: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:26:56.961534  7670 raft_consensus.cc:3060] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:56.961342  7203 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:56.963461  7787 raft_consensus.cc:2804] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:56.963841  7787 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.964187  7787 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:56.954073  7645 raft_consensus.cc:2804] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:56.966405  7645 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.966769  7645 raft_consensus.cc:3060] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.968643  7649 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.969297  7009 raft_consensus.cc:1240] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:56.969200  7649 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:56.971747  7054 leader_election.cc:400] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Vote denied by peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921) with higher term. Message: Invalid argument: T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4.
I20260709 12:26:56.972049  7054 leader_election.cc:403] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:26:56.958968  7665 consensus_queue.cc:237] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:56.978910  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:56.979259  7631 leader_election.cc:290] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:56.979851  7164 raft_consensus.cc:2393] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 2: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:26:56.981334  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:56.984500  7633 leader_election.cc:290] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:26:56.990422  7203 leader_election.cc:343] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:56.990912  7203 leader_election.cc:304] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:56.993634  7528 consensus_queue.cc:1059] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:56.996490  7528 raft_consensus.cc:3055] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:56.994670  7633 raft_consensus.cc:2749] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:56.997656  7528 raft_consensus.cc:740] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:56.999653  7528 consensus_queue.cc:260] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:57.002532  7528 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:57.005663  7128 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:56.975363  7640 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:56.987709  7014 raft_consensus.cc:1275] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:57.026232  7809 leader_election.cc:290] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:57.026482  7665 raft_consensus.cc:3060] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:57.028685  7650 raft_consensus.cc:2749] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:57.028996  7739 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:57.018854  7754 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:57.080300  6980 leader_election.cc:304] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:26:57.085069  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 93218.8us
I20260709 12:26:57.023171  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:26:57.090358  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.015008  7787 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:57.094647  6980 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:57.096316  6980 leader_election.cc:304] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:57.124408  6980 leader_election.cc:304] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:56.977653  7630 consensus_queue.cc:237] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:57.121182  7752 raft_consensus.cc:2749] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:57.122572  7680 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.133169  7727 raft_consensus.cc:2749] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:57.126216  7754 raft_consensus.cc:2749] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:57.144222  7723 raft_consensus.cc:2804] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.125512  7016 raft_consensus.cc:2468] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
W20260709 12:26:57.125536  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 295341us
I20260709 12:26:57.226667  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:57.227567  7285 tablet_bootstrap.cc:492] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:57.228116  7285 ts_tablet_manager.cc:1403] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.632s	user 0.018s	sys 0.001s
W20260709 12:26:57.233668  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 227520us
I20260709 12:26:57.234989  7202 leader_election.cc:304] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:57.202735  7723 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:57.248940  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:57.249473  7723 raft_consensus.cc:3060] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.202747  7782 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:57.254457  7287 tablet_bootstrap.cc:492] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:57.258133  7287 ts_tablet_manager.cc:1403] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.653s	user 0.034s	sys 0.015s
I20260709 12:26:57.203941  7680 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:26:57.260267  7828 log.cc:927] Time spent T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:26:57.232182  7650 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:57.253664  7631 raft_consensus.cc:2804] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:57.254544  7809 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.254297  7649 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:57.262074  7680 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:26:57.284155  7829 log.cc:927] Time spent T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:26:57.287181  7232 raft_consensus.cc:2468] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
W20260709 12:26:57.289275  7793 log.cc:927] Time spent T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:26:57.290843  7284 tablet_bootstrap.cc:492] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:57.268383  7727 raft_consensus.cc:493] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.304128  7284 ts_tablet_manager.cc:1403] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.762s	user 0.031s	sys 0.023s
I20260709 12:26:57.280493  7631 raft_consensus.cc:493] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:57.309367  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 53362.9us
I20260709 12:26:57.298009  7718 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.268832  7782 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:57.315095  7727 raft_consensus.cc:515] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:57.316045  6980 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:26:57.317402  7285 raft_consensus.cc:359] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:57.319087  7285 raft_consensus.cc:385] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.319504  7285 raft_consensus.cc:740] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.324242  7727 leader_election.cc:290] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:57.307729  7631 raft_consensus.cc:3060] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:57.309715  7752 raft_consensus.cc:493] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.331365  7285 consensus_queue.cc:260] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:57.302233  7650 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:57.300272  7809 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:57.335812  7754 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.336421  7754 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:57.325198  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:57.347633  7287 raft_consensus.cc:359] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:57.348977  7287 raft_consensus.cc:385] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.333539  7727 raft_consensus.cc:2804] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:57.349653  7287 raft_consensus.cc:740] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.316604  7831 consensus_queue.cc:1048] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 12:26:57.340885  7787 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:57.324754  7833 consensus_queue.cc:1048] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:26:57.338464  7752 raft_consensus.cc:515] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:57.362285  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:57.363790  7640 raft_consensus.cc:2749] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921) with higher term. Message: Invalid argument: T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4.
I20260709 12:26:57.364341  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:57.368705  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:57.369971  7645 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:57.371397  7285 ts_tablet_manager.cc:1434] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.143s	user 0.008s	sys 0.002s
W20260709 12:26:57.374415  7647 consensus_meta.cc:287] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
I20260709 12:26:57.400688  7647 raft_consensus.cc:515] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:57.375788  7287 consensus_queue.cc:260] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:26:57.406234  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 66393.2us
I20260709 12:26:57.355587  7157 raft_consensus.cc:2468] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
W20260709 12:26:57.353163  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 96014us
I20260709 12:26:57.379305  7631 raft_consensus.cc:515] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:57.382100  7650 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:57.342118  7718 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:57.367797  7284 raft_consensus.cc:359] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:57.428182  7284 raft_consensus.cc:385] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.387789  7809 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:57.392532  7091 raft_consensus.cc:2468] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:57.392112  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:57.404384  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:57.434821  7232 raft_consensus.cc:3060] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.435638  7723 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:57.437829  7723 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:57.438475  7723 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.438957  7723 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:26:57.441103  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.428471  7284 raft_consensus.cc:740] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.421897  7285 tablet_bootstrap.cc:492] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:57.415446  7716 raft_consensus.cc:493] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:57.427759  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:57.432660  7718 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:57.434213  7645 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:57.443343  7284 consensus_queue.cc:260] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:57.411872  7754 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:57.449908  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:57.428689  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:57.453508  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:57.453717  7158 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:57.454155  7237 raft_consensus.cc:2468] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:57.428969  7727 raft_consensus.cc:697] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:57.457639  7630 consensus_queue.cc:1048] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:57.458202  7131 leader_election.cc:343] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.460813  7630 consensus_queue.cc:1048] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:57.452076  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:57.461056  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:57.461570  7647 leader_election.cc:290] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:57.461689  7082 raft_consensus.cc:2468] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:26:57.452638  7633 consensus_queue.cc:1048] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:57.462361  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:57.462765  7727 consensus_queue.cc:237] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:57.460637  7716 raft_consensus.cc:515] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:57.453058  7631 leader_election.cc:290] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:57.464453  7284 ts_tablet_manager.cc:1434] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.160s	user 0.007s	sys 0.000s
I20260709 12:26:57.465243  7716 leader_election.cc:290] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:57.465553  7284 tablet_bootstrap.cc:492] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:57.463352  7010 raft_consensus.cc:2410] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:26:57.466881  7232 raft_consensus.cc:2468] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:57.472951  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:57.473724  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:57.473892  7016 raft_consensus.cc:2468] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:26:57.474435  7082 raft_consensus.cc:3060] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.475163  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:57.476155  7015 raft_consensus.cc:2393] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 1: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:26:57.477721  7752 leader_election.cc:290] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:57.477842  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:57.478511  7015 raft_consensus.cc:3060] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:57.445241  7782 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:57.450759  7165 raft_consensus.cc:2468] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:26:57.448172  7013 raft_consensus.cc:2468] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:26:57.481331  7202 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:57.448943  7203 leader_election.cc:304] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:26:57.475387  7825 log.cc:927] Time spent T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 12:26:57.427430  7838 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.484467  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:57.446198  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:57.489684  7091 raft_consensus.cc:2468] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:26:57.457670  7007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 161) took 1203 ms. Trace:
I20260709 12:26:57.493145  7778 raft_consensus.cc:2804] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:57.500034  7163 raft_consensus.cc:2393] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 2: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
W20260709 12:26:57.502691  7128 leader_election.cc:343] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.503419  7801 raft_consensus.cc:2804] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:57.503868  7801 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:57.504240  7801 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:57.495137  7665 raft_consensus.cc:2749] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:57.509281  7285 tablet_bootstrap.cc:654] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.497063  7723 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:57.506140  7778 raft_consensus.cc:493] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.496101  7007 rpcz_store.cc:276] 0709 12:26:56.254038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.257580 (+  3542us) service_pool.cc:224] Handling call
0709 12:26:56.258124 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:56.847809 (+589685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:57.457366 (+609557us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54002f94d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:26:57.457566 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1112836480}
I20260709 12:26:57.514094  7778 raft_consensus.cc:3060] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:57.520221  7128 leader_election.cc:304] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:57.521445  7665 raft_consensus.cc:2804] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:57.522039  7665 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.522550  7665 raft_consensus.cc:3060] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:57.529381  7845 raft_consensus.cc:493] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.530190  7845 raft_consensus.cc:515] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:57.533331  7845 leader_election.cc:290] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:57.534607  7055 leader_election.cc:304] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:57.542321  7015 raft_consensus.cc:2468] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:26:57.543452  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:57.544045  7202 leader_election.cc:304] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:57.544986  7739 raft_consensus.cc:2804] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:57.545148  7158 raft_consensus.cc:2468] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:26:57.545897  7739 raft_consensus.cc:697] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:57.547019  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:57.546864  7739 consensus_queue.cc:237] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:57.548177  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:57.548338  7842 raft_consensus.cc:493] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.548916  7842 raft_consensus.cc:515] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:57.551230  7842 leader_election.cc:290] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:57.553193  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:57.552342  7718 raft_consensus.cc:2804] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:57.554219  7718 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:57.554651  7718 raft_consensus.cc:3060] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:57.496872  7838 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:57.556469  6982 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:26:57.564343  7205 leader_election.cc:343] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.566347  6982 leader_election.cc:304] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
W20260709 12:26:57.570118  6982 leader_election.cc:343] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:57.570910  6982 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:57.572695  7239 raft_consensus.cc:1275] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:57.573025  6982 leader_election.cc:304] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:57.537465  7690 raft_consensus.cc:493] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:57.577087  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:57.593029  7835 raft_consensus.cc:2804] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:57.593716  7835 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.594166  7835 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:57.596733  7203 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:57.574898  7845 raft_consensus.cc:2749] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:57.580047  7727 raft_consensus.cc:2804] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:57.580305  7842 consensus_queue.cc:1048] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:26:57.602926  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:57.722762  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:57.574707  7787 consensus_queue.cc:1048] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 12:26:57.598650  7014 raft_consensus.cc:2468] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:26:57.711763  7727 raft_consensus.cc:493] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.595762  7690 raft_consensus.cc:515] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:26:57.838810  7843 log.cc:927] Time spent T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:26:57.839061  7844 raft_consensus.cc:2804] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:57.836874  7727 raft_consensus.cc:3060] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:57.839740  7844 raft_consensus.cc:493] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.840605  7844 raft_consensus.cc:3060] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:57.839741  7816 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.889071  7091 raft_consensus.cc:1275] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:57.892925  7807 raft_consensus.cc:3055] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:26:57.909150  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 305765us
W20260709 12:26:57.887665  7846 log.cc:927] Time spent T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.333s	user 0.006s	sys 0.002s
I20260709 12:26:57.930153  7203 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:57.910459  6980 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:57.926717  7284 tablet_bootstrap.cc:654] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.908128  7287 ts_tablet_manager.cc:1434] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.650s	user 0.012s	sys 0.019s
I20260709 12:26:57.899892  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:57.903028  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:57.944167  6980 leader_election.cc:304] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:57.901229  7288 consensus_queue.cc:260] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:57.887146  7716 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:57.886365  7690 leader_election.cc:290] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:57.900666  7165 raft_consensus.cc:1240] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:57.903460  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:57.900274  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:57.904284  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:57.898937  7158 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:57.908828  7528 raft_consensus.cc:2749] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:57.904394  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:57.898710  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
W20260709 12:26:57.941953  7287 ts_tablet_manager.cc:1467] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6: Tablet startup took 683ms
I20260709 12:26:57.927002  7807 raft_consensus.cc:740] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:57.898061  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:57.909488  7642 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:57.969871  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:57.951282  7670 raft_consensus.cc:493] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.968891  7163 raft_consensus.cc:2468] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:26:57.975926  7091 raft_consensus.cc:2468] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:26:57.927021  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:57.884737  7718 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:57.892846  7665 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:57.957360  7782 raft_consensus.cc:2804] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:57.907351  7844 raft_consensus.cc:515] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:57.903390  7801 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:57.988381  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:57.975533  7852 raft_consensus.cc:493] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:57.973570  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:57.977756  7842 raft_consensus.cc:493] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.961555  7716 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:57.978094  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:57.925758  7816 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:58.009289  7236 raft_consensus.cc:2393] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 1: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:26:58.009006  7807 consensus_queue.cc:260] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:58.009861  7832 raft_consensus.cc:493] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.011300  7642 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:58.009092  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:58.012519  7013 raft_consensus.cc:1240] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:26:58.013500  7718 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:58.013760  7844 leader_election.cc:290] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:58.013792  7852 raft_consensus.cc:515] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:26:58.046140  7082 consensus_meta.cc:287] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.004s
I20260709 12:26:58.046746  7082 raft_consensus.cc:2468] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:58.047722  7088 raft_consensus.cc:2468] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:26:58.048115  7852 leader_election.cc:290] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:58.048806  7690 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.049327  7690 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:58.050246  7716 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:58.051373  7690 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:26:57.973119  7287 ts_tablet_manager.cc:1469] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6: Trace:
0709 12:26:43.980700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.872145 (+891445us) service_pool.cc:224] Handling call
0709 12:26:44.944278 (+ 72133us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:44.944406 (+   128us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.185935 (+241529us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.310977 (+125042us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.311392 (+   415us) inbound_call.cc:177] Queueing success response
0709 12:26:56.604875 (+11293483us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:26:57.258526 (+653651us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:26:57.301043 (+ 42517us) tablet_replica.cc:261] Starting instrumentation
0709 12:26:57.301767 (+   724us) tablet_replica.cc:280] Starting consensus
0709 12:26:57.906941 (+605174us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b18001833a0. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287dfefab1 00007f287dffc281 00007f2877dbc4bc 00007f287510a48b 00007f287df649a9 00007f287512669b 00007f287512493f 00007f2875124455 00007f287820c060 00007f2878209d71 00007f287bc06b2e
Metrics: {"mutex_wait_us":11691,"raft.queue_time_us":75997,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":3446,"spinlock_wait_cycles":2941184,"tablet-open.queue_time_us":11293552,"thread_start_us":82213,"threads_started":1}
I20260709 12:26:58.060089  7231 raft_consensus.cc:2393] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 2: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:26:58.061329  7287 tablet_bootstrap.cc:492] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:58.031939  7842 raft_consensus.cc:515] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:57.983665  7670 raft_consensus.cc:515] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:58.064640  7842 leader_election.cc:290] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:58.017334  7727 raft_consensus.cc:515] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:58.011860  7688 raft_consensus.cc:493] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.065752  7688 raft_consensus.cc:515] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:58.066334  7665 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:58.067974  7688 leader_election.cc:290] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:58.045928  7807 raft_consensus.cc:3060] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.015427  7801 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:57.986708  7835 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:58.052160  7644 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:58.052672  7778 consensus_meta.cc:287] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.533s	user 0.015s	sys 0.002s
I20260709 12:26:58.076890  7778 raft_consensus.cc:515] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:58.077963  7723 raft_consensus.cc:2804] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:58.078193  7647 raft_consensus.cc:2804] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:58.079258  7778 leader_election.cc:290] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:26:58.078019  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 133927us
I20260709 12:26:58.080545  6980 leader_election.cc:304] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:58.076900  7015 raft_consensus.cc:2393] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 3: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:26:58.053133  7285 tablet_bootstrap.cc:492] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:58.083381  7844 raft_consensus.cc:2749] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.083822  7285 ts_tablet_manager.cc:1403] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.673s	user 0.039s	sys 0.037s
I20260709 12:26:58.078210  7642 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:58.085210  7644 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:58.085657  7845 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.086207  7845 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:58.087368  7647 raft_consensus.cc:697] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:58.078442  7723 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.053241  7832 raft_consensus.cc:515] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:58.017217  7232 raft_consensus.cc:2410] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:26:58.059165  7816 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:58.065088  7088 raft_consensus.cc:1275] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:26:58.071182  7782 raft_consensus.cc:697] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:58.075215  7838 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:26:58.090539  7129 leader_election.cc:343] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.098091  7129 leader_election.cc:304] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:58.100397  7088 pending_rounds.cc:85] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca: Aborting all ops after (but not including) 1
I20260709 12:26:58.087383  7644 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:58.083443  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:58.102551  7650 raft_consensus.cc:2749] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.087949  7723 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.116639  7088 pending_rounds.cc:107] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:26:58.119836  7238 raft_consensus.cc:2468] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:26:58.125550  7088 raft_consensus.cc:2889] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:58.117501  7008 raft_consensus.cc:1240] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:58.115938  7838 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:26:58.148913  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:58.150954  7239 raft_consensus.cc:2468] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
W20260709 12:26:58.157372  7129 leader_election.cc:343] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.217994  7236 raft_consensus.cc:1275] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:58.218211  7835 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:58.159933  7782 consensus_queue.cc:237] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:58.216198  7840 raft_consensus.cc:493] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:58.219702  7840 raft_consensus.cc:515] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:58.225222  7845 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:58.226384  7840 leader_election.cc:290] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:58.227159  7835 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:58.227767  7835 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:58.228951  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:58.229600  7014 raft_consensus.cc:3060] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.229961  7835 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:58.156342  7690 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:58.234130  7205 leader_election.cc:343] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.241611  7205 leader_election.cc:304] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:58.249871  7285 raft_consensus.cc:359] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:58.244798  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:58.151648  7647 consensus_queue.cc:237] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:58.251845  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:58.251998  7158 raft_consensus.cc:1275] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:58.226457  7851 log.cc:927] Time spent T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:26:58.249997  7690 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:58.259860  7287 tablet_bootstrap.cc:654] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.245044  7642 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:58.262224  7832 leader_election.cc:290] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:58.262820  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:58.154927  7838 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:58.264832  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:58.299525  7719 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.300077  7719 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:58.300457  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:58.265573  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:58.303608  7160 raft_consensus.cc:2468] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:26:58.265903  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:58.303906  7642 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:58.269016  7014 raft_consensus.cc:2468] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:26:58.270490  7650 consensus_queue.cc:1048] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:58.271489  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:58.306097  7642 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:58.306480  7159 raft_consensus.cc:2468] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:26:58.272372  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:58.306682  7723 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:58.273571  7156 raft_consensus.cc:1275] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:58.272260  7865 consensus_queue.cc:1048] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:26:58.274183  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:58.275085  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:58.277112  7778 raft_consensus.cc:2749] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.281800  7852 consensus_queue.cc:1059] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:58.282236  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:58.329030  7852 raft_consensus.cc:3055] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:58.281509  7055 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:58.324937  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:58.330137  7838 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:26:58.330317  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 48929.3us
I20260709 12:26:58.330358  7162 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.331236  7055 leader_election.cc:304] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:58.292662  7285 raft_consensus.cc:385] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.331957  7285 raft_consensus.cc:740] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.302969  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:58.269945  7131 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:58.332706  7285 consensus_queue.cc:260] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:26:58.311149  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:58.320094  7237 raft_consensus.cc:1275] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:58.320238  7719 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:58.307765  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:58.321612  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:58.329636  7852 raft_consensus.cc:740] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:26:58.288997  7727 leader_election.cc:290] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:58.337819  7233 raft_consensus.cc:1240] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:58.337908  7852 consensus_queue.cc:260] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:58.339143  7163 raft_consensus.cc:2468] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 0.
I20260709 12:26:58.339392  7852 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.339529  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:58.335443  7789 raft_consensus.cc:2804] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:58.340230  7084 raft_consensus.cc:2468] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:26:58.340742  7235 raft_consensus.cc:2468] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:26:58.335199  7642 raft_consensus.cc:2749] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:58.345119  7284 tablet_bootstrap.cc:492] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:58.345422  7161 raft_consensus.cc:2468] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:26:58.345937  7284 ts_tablet_manager.cc:1403] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.881s	user 0.031s	sys 0.004s
I20260709 12:26:58.348807  7236 raft_consensus.cc:2468] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:26:58.350059  7789 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.350660  7789 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.351469  7288 ts_tablet_manager.cc:1434] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 1.734s	user 0.037s	sys 0.033s
W20260709 12:26:58.351819  7288 ts_tablet_manager.cc:1467] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41: Tablet startup took 1734ms
I20260709 12:26:58.358143  6980 leader_election.cc:304] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:26:58.358992  7205 leader_election.cc:343] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.357918  7202 leader_election.cc:304] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:58.364490  7719 raft_consensus.cc:2804] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:58.362601  7838 consensus_queue.cc:1048] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:26:58.364948  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
W20260709 12:26:58.365432  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 95593.7us
I20260709 12:26:58.365660  7009 raft_consensus.cc:1275] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:58.366115  7091 raft_consensus.cc:3055] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:58.366447  7091 raft_consensus.cc:740] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:26:58.367151  7091 consensus_queue.cc:260] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:58.367624  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:58.368029  7091 raft_consensus.cc:3060] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.368294  7085 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:26:58.335743  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:58.362460  6980 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:58.373669  7690 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:58.374433  7011 raft_consensus.cc:1240] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:58.375423  7670 leader_election.cc:290] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:58.364501  7868 raft_consensus.cc:2804] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:58.376652  7868 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:58.377288  7868 raft_consensus.cc:3060] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.365701  7007 raft_consensus.cc:2368] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3.
I20260709 12:26:58.364987  7719 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.381311  7091 raft_consensus.cc:1275] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:26:58.382381  7091 pending_rounds.cc:85] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca: Aborting all ops after (but not including) 1
I20260709 12:26:58.382753  7091 pending_rounds.cc:107] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:26:58.383805  7091 raft_consensus.cc:2889] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:58.384835  7285 ts_tablet_manager.cc:1434] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.301s	user 0.007s	sys 0.019s
I20260709 12:26:58.381685  7719 raft_consensus.cc:3060] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.386462  7723 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:58.380353  7727 raft_consensus.cc:2804] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:58.387336  7727 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.387714  7727 raft_consensus.cc:3060] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.391040  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:26:58.352077  7288 ts_tablet_manager.cc:1469] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41: Trace:
0709 12:26:44.261898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.625793 (+1363895us) service_pool.cc:224] Handling call
0709 12:26:45.628199 (+  2406us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.628325 (+   126us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.780876 (+152551us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.802780 (+ 21904us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.803421 (+   641us) inbound_call.cc:177] Queueing success response
0709 12:26:56.334633 (+10531212us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:26:56.617337 (+282704us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:26:56.822333 (+204996us) tablet_replica.cc:261] Starting instrumentation
0709 12:26:56.823156 (+   823us) tablet_replica.cc:280] Starting consensus
0709 12:26:57.717045 (+893889us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b4c0030dd00. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f28764e0a20 00007f28764f1a29 00007f28764b7644 00007f28764def2d 00007f28764deb93 00007f287820f18b 00007f287820fcb5 00007f287820af30 00007f2878209c40 00007f287bc06b2e 00007f287d228d8a
0709 12:26:58.350532 (+633487us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400080a54. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f287820b12e 00007f2878209c8d 00007f287bc06b2e 00007f287d228d8a 00007f287d23cd01 00007f287d23cca9 00007f287d23cc39 00007f287d23cc01 00007f287d23bedd 0000000000388634
Metrics: {"mutex_wait_us":24908,"raft.queue_time_us":3189,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":5118,"spinlock_wait_cycles":277003008,"tablet-open.queue_time_us":10531289}
W20260709 12:26:58.394207  6980 leader_election.cc:343] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.396744  7288 tablet_bootstrap.cc:492] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:58.397257  7285 tablet_bootstrap.cc:492] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:58.405817  7642 raft_consensus.cc:493] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.406590  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:58.407269  7013 raft_consensus.cc:2468] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:26:58.407433  7129 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:58.403901  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:58.406351  7642 raft_consensus.cc:515] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:58.404844  7690 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.394276  7284 raft_consensus.cc:359] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:58.418252  7284 raft_consensus.cc:385] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.419333  7650 raft_consensus.cc:2804] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:58.419727  7650 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.419761  7642 leader_election.cc:290] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:58.420163  7650 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.420248  7690 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:58.420842  7727 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:58.422384  7690 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:58.422501  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:58.423245  7163 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.424237  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:58.424386  7528 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:58.425063  7528 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:58.427377  7528 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:58.430655  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:58.420162  7833 consensus_queue.cc:1048] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:26:58.418666  7284 raft_consensus.cc:740] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.400395  7719 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:58.438066  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:58.418926  7129 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:58.403800  7205 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:58.438879  7284 consensus_queue.cc:260] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:58.438189  7788 consensus_queue.cc:1048] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.441542  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:58.441998  7284 ts_tablet_manager.cc:1434] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.001s
I20260709 12:26:58.442637  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:58.443295  7284 tablet_bootstrap.cc:492] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:58.443965  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:58.443295  7007 raft_consensus.cc:2468] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:26:58.438123  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:58.451510  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:58.451609  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:58.452567  7011 raft_consensus.cc:2393] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 2: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:26:58.452921  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
W20260709 12:26:58.453624  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 49904.9us
I20260709 12:26:58.454347  7163 raft_consensus.cc:2468] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:26:58.448026  7833 raft_consensus.cc:2749] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:58.448146  7013 raft_consensus.cc:2393] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 4: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:26:58.454980  7645 consensus_queue.cc:1048] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:58.454561  7778 raft_consensus.cc:2804] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:58.456100  7778 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.456496  7778 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:58.456918  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:58.458688  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:58.459362  7011 raft_consensus.cc:2468] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:26:58.466076  7778 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:58.466668  7670 consensus_queue.cc:1048] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.468470  7778 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:58.452467  7239 raft_consensus.cc:1240] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:58.473141  7202 leader_election.cc:400] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Vote denied by peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921) with higher term. Message: Invalid argument: T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3.
I20260709 12:26:58.473475  7202 leader_election.cc:403] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:26:58.474614  7787 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.475739  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:58.477501  6980 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:58.478370  7650 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:58.479159  7788 raft_consensus.cc:2804] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:58.479709  7788 raft_consensus.cc:697] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:58.483783  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:58.484404  7089 raft_consensus.cc:3060] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.484738  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:58.485386  7287 tablet_bootstrap.cc:492] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:58.485906  7287 ts_tablet_manager.cc:1403] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.425s	user 0.017s	sys 0.009s
I20260709 12:26:58.486876  7202 leader_election.cc:304] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:58.483626  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
W20260709 12:26:58.488035  7202 leader_election.cc:343] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.488634  7010 raft_consensus.cc:2393] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 4: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:26:58.488852  7865 consensus_queue.cc:1048] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:58.491308  7631 raft_consensus.cc:2804] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:58.491704  7631 raft_consensus.cc:493] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.492033  7631 raft_consensus.cc:3060] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:58.493330  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:58.493948  7086 raft_consensus.cc:2468] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:26:58.497309  7129 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:58.473374  7162 raft_consensus.cc:2468] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:26:58.498323  7202 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:58.463941  7852 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:58.501006  7234 raft_consensus.cc:2393] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 3: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:26:58.501407  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:58.501704  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:58.501435  7236 raft_consensus.cc:1240] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:58.504666  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:58.506560  6980 leader_election.cc:304] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
W20260709 12:26:58.558980  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 52521.5us
I20260709 12:26:58.498764  7055 leader_election.cc:304] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:58.508810  7665 raft_consensus.cc:2764] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:26:58.512035  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:58.512657  7723 raft_consensus.cc:493] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.568697  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:58.568899  7723 raft_consensus.cc:515] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:58.569411  7238 raft_consensus.cc:2468] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 0.
I20260709 12:26:58.569902  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:58.513290  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:58.512923  7739 raft_consensus.cc:2804] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:58.573158  7739 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:26:58.573662  7739 raft_consensus.cc:3060] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.514178  7852 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:58.509428  7690 consensus_queue.cc:1048] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:26:58.516106  7838 raft_consensus.cc:493] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:58.516662  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:58.517416  7161 raft_consensus.cc:1240] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:58.518195  7719 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:58.480569  7788 consensus_queue.cc:237] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:58.480500  7650 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:58.558665  7164 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:26:58.563535  7285 tablet_bootstrap.cc:654] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.567085  7054 leader_election.cc:304] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:58.569208  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:58.511890  6913 catalog_manager.cc:5697] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 1 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } }
I20260709 12:26:58.513082  7823 raft_consensus.cc:2749] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:58.574928  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 76214.1us
I20260709 12:26:58.574522  7840 raft_consensus.cc:2804] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:58.571429  7723 leader_election.cc:290] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:58.581079  6980 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:58.449177  7789 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:58.582461  7288 tablet_bootstrap.cc:654] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:58.574927  7057 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.447395  7868 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:58.590066  6913 catalog_manager.cc:5697] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 1 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } }
I20260709 12:26:58.567641  7287 raft_consensus.cc:359] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:58.591704  7055 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:58.588241  7233 raft_consensus.cc:2393] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 3: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:26:58.578190  7159 raft_consensus.cc:3060] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:58.595423  7054 leader_election.cc:304] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:58.580475  7642 raft_consensus.cc:2804] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:58.602676  7287 raft_consensus.cc:385] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.604193  7287 raft_consensus.cc:740] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.601387  6913 catalog_manager.cc:5697] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 1 to 2, leader changed from 022925662268440c91fff7e8732d7a0b (127.3.200.67) to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } }
I20260709 12:26:58.610947  7688 consensus_queue.cc:1048] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:58.611292  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:58.596406  7013 raft_consensus.cc:3060] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.608888  7642 raft_consensus.cc:493] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.596230  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:58.618260  7642 raft_consensus.cc:3060] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:58.593895  7840 raft_consensus.cc:493] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.620879  7840 raft_consensus.cc:3060] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:58.621151  7873 log.cc:927] Time spent T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:26:58.625288  7163 raft_consensus.cc:2368] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3.
I20260709 12:26:58.626282  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:58.625985  6913 catalog_manager.cc:5697] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 1 to 2, leader changed from 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65) to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 2 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } }
I20260709 12:26:58.626993  7161 raft_consensus.cc:3060] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.617424  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:58.610183  7128 leader_election.cc:304] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:58.630229  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:58.628041  6913 catalog_manager.cc:5697] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 1 to 2, leader changed from 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65) to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 2 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } }
I20260709 12:26:58.634258  7287 consensus_queue.cc:260] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:58.601053  7647 raft_consensus.cc:2804] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:26:58.638669  7203 leader_election.cc:343] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.639882  7203 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:58.638805  7007 raft_consensus.cc:2468] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:26:58.601276  7650 raft_consensus.cc:493] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:58.641776  7852 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:58.607091  7528 raft_consensus.cc:493] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:58.647202  7203 leader_election.cc:343] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.647818  7203 leader_election.cc:304] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:58.593257  7838 raft_consensus.cc:515] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:58.649626  7719 raft_consensus.cc:2804] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:58.649709  7853 raft_consensus.cc:2749] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:58.641817  7564 raft_consensus.cc:2804] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:58.624761  7089 raft_consensus.cc:2468] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
W20260709 12:26:58.666544  6980 leader_election.cc:343] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.646389  7727 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:58.661754  7287 ts_tablet_manager.cc:1434] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.176s	user 0.014s	sys 0.009s
I20260709 12:26:58.680763  7645 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.658702  7690 raft_consensus.cc:2804] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:58.644630  7833 consensus_queue.cc:1059] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 12:26:58.652041  7647 raft_consensus.cc:697] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:58.657600  7719 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:26:58.646554  7688 consensus_queue.cc:1059] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:26:58.682446  7564 raft_consensus.cc:697] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:58.680459  7778 raft_consensus.cc:2749] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.702625  7287 tablet_bootstrap.cc:492] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
W20260709 12:26:58.701363  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 109767us
I20260709 12:26:58.652439  7650 raft_consensus.cc:515] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:58.660835  7852 raft_consensus.cc:2749] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:58.699422  7645 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:58.698913  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:58.699586  7690 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:58.706454  7789 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:58.709852  7780 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:58.658512  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 63134.2us
I20260709 12:26:58.658456  7528 raft_consensus.cc:515] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:58.665710  7835 consensus_queue.cc:1059] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:26:58.741842  7054 leader_election.cc:304] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:58.704146  7719 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:58.717103  7055 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.727149  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:58.728858  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:58.746755  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:58.748070  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:58.748459  7647 consensus_queue.cc:237] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:58.731019  7159 raft_consensus.cc:2468] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:26:58.731792  7564 consensus_queue.cc:237] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:26:58.737119  7875 log.cc:927] Time spent T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:26:58.734126  7739 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:58.753901  7055 leader_election.cc:304] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:58.736620  7233 raft_consensus.cc:3060] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.715592  7631 raft_consensus.cc:515] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:58.721213  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:58.737528  7688 raft_consensus.cc:3055] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:58.737624  7868 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:58.739249  7650 leader_election.cc:290] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:58.739466  7284 tablet_bootstrap.cc:654] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.746155  7878 raft_consensus.cc:2749] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:58.745409  7054 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:58.723584  7690 raft_consensus.cc:3060] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.747562  7158 raft_consensus.cc:2393] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 3: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:26:58.742146  7013 raft_consensus.cc:2468] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:26:58.782923  7239 raft_consensus.cc:2468] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:26:58.774423  7055 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:58.775171  7852 raft_consensus.cc:2749] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:58.750975  7727 raft_consensus.cc:493] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.786686  7054 leader_election.cc:304] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:58.789167  7202 leader_election.cc:304] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:26:58.800585  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 55402.7us
I20260709 12:26:58.779186  7688 raft_consensus.cc:740] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:58.801816  7055 leader_election.cc:304] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:58.803610  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:58.805275  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:58.808022  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:58.810899  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:58.811667  7631 leader_election.cc:290] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:58.811862  7087 raft_consensus.cc:2393] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 2: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:26:58.812641  7842 raft_consensus.cc:2749] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:58.811933  7288 tablet_bootstrap.cc:492] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:26:58.813515  7288 ts_tablet_manager.cc:1403] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.417s	user 0.018s	sys 0.015s
I20260709 12:26:58.789117  7789 raft_consensus.cc:2749] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:58.750478  7780 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:58.812261  7880 raft_consensus.cc:2804] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:58.819090  7287 tablet_bootstrap.cc:654] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.781688  7642 raft_consensus.cc:515] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:58.826609  7642 leader_election.cc:290] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:58.826808  7645 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:58.828007  7787 raft_consensus.cc:2749] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921) with higher term. Message: Invalid argument: T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3.
I20260709 12:26:58.817631  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:58.828984  7089 raft_consensus.cc:2468] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:26:58.829479  7823 raft_consensus.cc:3055] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:58.829964  7823 raft_consensus.cc:740] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:26:58.799786  7838 leader_election.cc:290] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:58.822614  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:58.824568  7528 leader_election.cc:290] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:58.809688  7778 raft_consensus.cc:2804] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:58.832439  7091 raft_consensus.cc:2393] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 3: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:26:58.835589  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:58.835558  7823 consensus_queue.cc:260] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:58.845153  7823 raft_consensus.cc:3060] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:58.845315  7236 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:26:58.797155  7727 raft_consensus.cc:515] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:26:58.846308  7202 leader_election.cc:343] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.858920  7727 leader_election.cc:290] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:58.867091  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:58.815526  7883 raft_consensus.cc:2749] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:58.874334  7288 raft_consensus.cc:359] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:58.878806  7288 raft_consensus.cc:385] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.879202  7288 raft_consensus.cc:740] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.837888  7880 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.885152  7285 tablet_bootstrap.cc:492] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:58.885840  7285 ts_tablet_manager.cc:1403] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.489s	user 0.017s	sys 0.010s
I20260709 12:26:59.017202  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:59.026261  7288 consensus_queue.cc:260] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:58.881155  7778 raft_consensus.cc:697] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:59.018956  7844 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.955076  7880 raft_consensus.cc:3060] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.031288  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:58.954404  7840 raft_consensus.cc:515] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:59.115926  7013 raft_consensus.cc:2393] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 1: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:26:59.116655  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:58.883533  7688 consensus_queue.cc:260] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:59.121353  7780 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:59.127012  7285 raft_consensus.cc:359] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:59.127816  7285 raft_consensus.cc:385] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.128113  7285 raft_consensus.cc:740] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.120218  7690 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:59.055294  7844 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:59.132678  7690 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:59.133600  7844 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:59.135728  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:59.120188  7233 raft_consensus.cc:2468] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:26:59.055054  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:59.137311  7285 consensus_queue.cc:260] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:59.146692  6980 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:59.151849  6982 leader_election.cc:304] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:59.154235  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:59.098791  7883 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:59.155444  6982 leader_election.cc:304] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:59.142689  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:59.143672  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:59.143998  7789 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:59.143672  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:59.144505  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:59.157232  7239 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 4.
I20260709 12:26:59.121400  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:59.155414  7090 raft_consensus.cc:2393] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 2: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:26:59.159737  6982 leader_election.cc:304] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:59.179279  6980 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:59.148048  7842 raft_consensus.cc:493] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:59.184402  7285 ts_tablet_manager.cc:1434] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.298s	user 0.007s	sys 0.001s
I20260709 12:26:59.158296  7845 raft_consensus.cc:2804] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:59.186558  6982 leader_election.cc:304] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:59.169764  7844 raft_consensus.cc:2749] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:59.178285  7835 raft_consensus.cc:2749] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:59.179800  7163 raft_consensus.cc:3060] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:59.183185  7161 consensus_meta.cc:287] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.001s
I20260709 12:26:59.196518  7161 raft_consensus.cc:2468] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:26:59.197510  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:59.198266  7014 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:26:59.190883  7647 raft_consensus.cc:2804] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:59.200858  7647 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.201215  7647 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:59.190616  7778 consensus_queue.cc:237] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:59.153501  7727 consensus_queue.cc:1048] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 12:26:59.194181  7288 ts_tablet_manager.cc:1434] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.380s	user 0.012s	sys 0.006s
I20260709 12:26:59.177217  7883 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:59.212823  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:59.181830  7234 raft_consensus.cc:2468] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:26:59.214407  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:59.222409  7091 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 4.
I20260709 12:26:59.223073  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:59.180372  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:59.225131  7163 raft_consensus.cc:2468] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:26:59.162492  7789 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:59.228652  6982 leader_election.cc:304] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
W20260709 12:26:59.229856  6982 leader_election.cc:343] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.230263  6982 leader_election.cc:304] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:59.204231  7230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 61) took 1227 ms. Trace:
I20260709 12:26:59.228741  7844 raft_consensus.cc:2749] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:59.231103  6980 leader_election.cc:343] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.230937  7230 rpcz_store.cc:276] 0709 12:26:57.977023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.979391 (+  2368us) service_pool.cc:224] Handling call
0709 12:26:58.283193 (+303802us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:58.297393 (+ 14200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:58.298006 (+   613us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:58.307040 (+  9034us) log.cc:844] Serialized 26 byte log entry
0709 12:26:58.472659 (+165619us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b18003a6fc0. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287dfefab1 00007f287dffc281 00007f2875109e07 00007f287df649a9 00007f287512669b 00007f287512493f 00007f2875126c02 00007f2877dae20b 00007f2877db3d23 00007f2877db40d1 00007f28781cfa0f
0709 12:26:58.585406 (+112747us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:58.587494 (+  2088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.594791 (+  7297us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:58.800620 (+205829us) raft_consensus.cc:1685] finished
0709 12:26:58.807177 (+  6557us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:59.203946 (+396769us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54001a86d0. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782138ad 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:26:59.204120 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10920,"raft.queue_time_us":13753,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":4218,"spinlock_wait_cycles":635753216,"thread_start_us":94700,"threads_started":1,"wal-append.queue_time_us":327783}
I20260709 12:26:59.232391  7789 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:59.207882  7840 leader_election.cc:290] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:59.232980  7892 raft_consensus.cc:2749] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:59.187881  7788 raft_consensus.cc:2764] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:26:59.234570  6980 leader_election.cc:304] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:26:59.219542  7239 raft_consensus.cc:2393] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 1: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
W20260709 12:26:59.237264  6982 leader_election.cc:343] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.237682  6982 leader_election.cc:304] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:59.187199  7842 raft_consensus.cc:515] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:59.240025  7131 leader_election.cc:304] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:59.241526  7842 leader_election.cc:290] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:26:59.241753  7131 consensus_peers.cc:597] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b -> Peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Couldn't send request to peer 9e6e5c8ad44447588681b10df7ad79ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:59.242208  7835 consensus_queue.cc:1048] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:59.236755  6980 leader_election.cc:304] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:59.244503  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:59.245324  7012 raft_consensus.cc:2393] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 3: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:26:59.245440  7864 raft_consensus.cc:2804] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.245837  7864 raft_consensus.cc:493] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.246203  7864 raft_consensus.cc:3060] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.246243  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:26:59.248804  7287 tablet_bootstrap.cc:492] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:59.249303  7287 ts_tablet_manager.cc:1403] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.552s	user 0.084s	sys 0.053s
I20260709 12:26:59.215312  7845 raft_consensus.cc:697] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:59.255090  7892 raft_consensus.cc:2804] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:59.255661  7284 tablet_bootstrap.cc:492] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:26:59.254956  7287 raft_consensus.cc:359] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:59.256194  7284 ts_tablet_manager.cc:1403] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.813s	user 0.018s	sys 0.020s
I20260709 12:26:59.256399  7287 raft_consensus.cc:385] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.256796  7287 raft_consensus.cc:740] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.258982  7892 raft_consensus.cc:697] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:59.259925  7892 consensus_queue.cc:237] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:59.239205  7727 raft_consensus.cc:2749] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:59.269325  7202 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:59.251477  7719 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:59.251953  7788 raft_consensus.cc:2804] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.238796  7844 raft_consensus.cc:2749] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:59.279139  7528 raft_consensus.cc:2804] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:59.284706  7287 consensus_queue.cc:260] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:59.291824  7287 ts_tablet_manager.cc:1434] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.042s	user 0.011s	sys 0.000s
I20260709 12:26:59.291720  7723 raft_consensus.cc:3055] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:59.292320  7723 raft_consensus.cc:740] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:59.293152  7723 consensus_queue.cc:260] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:59.294559  7723 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.295007  7158 raft_consensus.cc:1275] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:59.293149  7845 consensus_queue.cc:237] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:59.296480  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:59.297171  7156 raft_consensus.cc:3060] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.299193  7739 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:59.300952  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:59.291934  7719 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:59.305099  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:59.305824  7883 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:59.306273  7287 tablet_bootstrap.cc:492] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
I20260709 12:26:59.306706  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:59.307104  7156 raft_consensus.cc:2468] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:26:59.308046  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:59.312795  7287 tablet_bootstrap.cc:654] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.284500  7528 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.314740  7528 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:59.315960  7088 raft_consensus.cc:3060] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.318539  7284 raft_consensus.cc:359] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:59.321635  7284 raft_consensus.cc:385] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.321938  7284 raft_consensus.cc:740] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.322696  7284 consensus_queue.cc:260] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:59.318915  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:59.319326  7647 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:59.336062  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:26:59.339576  6979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.280409  7788 raft_consensus.cc:697] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:26:59.361501  7788 consensus_queue.cc:237] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:59.367769  7880 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:59.349072  7723 consensus_queue.cc:1048] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:59.356032  7239 raft_consensus.cc:3060] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.356920  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:59.359203  7865 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.360103  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:59.369942  7285 tablet_bootstrap.cc:492] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:26:59.324649  7055 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:59.387445  7284 ts_tablet_manager.cc:1434] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.131s	user 0.007s	sys 0.000s
I20260709 12:26:59.355115  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:26:59.389313  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 64793.7us
I20260709 12:26:59.352746  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:59.393194  7055 leader_election.cc:304] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:26:59.397938  7690 raft_consensus.cc:2804] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.404340  7647 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:59.407258  7528 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:59.398710  7055 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:59.395128  7883 raft_consensus.cc:2749] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:59.399986  7230 raft_consensus.cc:2393] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 3: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:26:59.413096  7284 tablet_bootstrap.cc:492] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:26:59.413862  7239 raft_consensus.cc:2468] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:26:59.409744  7082 raft_consensus.cc:2368] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3.
I20260709 12:26:59.397401  7084 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:26:59.389262  7865 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:59.408631  7690 raft_consensus.cc:697] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:26:59.398829  7083 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
W20260709 12:26:59.429718  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 153414us
I20260709 12:26:59.410771  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:59.418536  7642 raft_consensus.cc:2749] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:59.428772  7787 raft_consensus.cc:493] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:59.468935  7232 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:59.495828  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:59.495712  7690 consensus_queue.cc:237] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:59.496450  7823 raft_consensus.cc:493] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:59.499742  7287 tablet_bootstrap.cc:492] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:26:59.501639  7287 ts_tablet_manager.cc:1403] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.196s	user 0.010s	sys 0.009s
I20260709 12:26:59.436527  7008 raft_consensus.cc:2468] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:26:59.499346  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:26:59.541990  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:59.545235  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.493424  7787 raft_consensus.cc:515] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:59.552577  7789 raft_consensus.cc:493] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.558646  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:59.614179  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:59.545010  7788 raft_consensus.cc:493] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:59.561254  7865 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:59.564756  7528 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:26:59.514935  7823 raft_consensus.cc:515] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:59.639569  7823 leader_election.cc:290] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:59.591445  7845 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:59.591522  7789 raft_consensus.cc:515] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:59.640482  7287 raft_consensus.cc:359] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:59.643738  7287 raft_consensus.cc:385] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.643999  7287 raft_consensus.cc:740] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.593418  7647 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:59.644774  7287 consensus_queue.cc:260] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:26:59.633489  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 215224us
I20260709 12:26:59.647733  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:59.649215  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:59.641285  7845 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:59.652019  7287 ts_tablet_manager.cc:1434] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.150s	user 0.001s	sys 0.005s
I20260709 12:26:59.652877  7845 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:59.653501  7238 raft_consensus.cc:1240] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:59.655128  7205 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:59.655594  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:59.656124  7091 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:59.599327  7088 raft_consensus.cc:2468] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:26:59.602382  7787 leader_election.cc:290] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:59.656512  7205 leader_election.cc:400] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713) with higher term. Message: Invalid argument: T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3.
I20260709 12:26:59.666152  7231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49174 (request call id 140) took 1029 ms. Trace:
I20260709 12:26:59.666589  7156 raft_consensus.cc:2468] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
W20260709 12:26:59.641417  7901 log.cc:927] Time spent T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 12:26:59.667433  7288 tablet_bootstrap.cc:492] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41: Bootstrap starting.
I20260709 12:26:59.528290  7645 raft_consensus.cc:493] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.668531  7645 raft_consensus.cc:515] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:59.662315  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:59.669725  7230 raft_consensus.cc:3060] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:59.670743  7645 leader_election.cc:290] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:59.617348  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:59.618569  7285 tablet_bootstrap.cc:654] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.618741  7880 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:59.541796  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:26:59.673442  7894 log.cc:927] Time spent T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.546s	user 0.006s	sys 0.014s
I20260709 12:26:59.673812  7202 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:59.674468  7673 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.644662  7647 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:59.674970  7673 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:59.675446  7084 raft_consensus.cc:1275] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:59.676771  7647 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:59.677021  7673 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:59.678299  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:26:59.682050  7888 log.cc:927] Time spent T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.553s	user 0.003s	sys 0.007s
I20260709 12:26:59.683281  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:59.634194  7788 raft_consensus.cc:515] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:59.684603  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:59.685444  7788 leader_election.cc:290] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:59.568935  7864 raft_consensus.cc:515] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:59.686189  7862 raft_consensus.cc:493] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:59.686750  7862 raft_consensus.cc:515] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:59.687479  7864 leader_election.cc:290] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:26:59.666704  7205 leader_election.cc:343] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.683506  7237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49174 (request call id 141) took 1015 ms. Trace:
I20260709 12:26:59.690338  7823 consensus_queue.cc:1048] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:59.689747  7237 rpcz_store.cc:276] 0709 12:26:58.697343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.703957 (+  6614us) service_pool.cc:224] Handling call
0709 12:26:58.709041 (+  5084us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:58.749254 (+ 40213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:58.749287 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:58.749810 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 12:26:59.046014 (+296204us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:59.047902 (+  1888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.498988 (+451086us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b54007102d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:26:59.499038 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:59.681386 (+182348us) spinlock_profiling.cc:243] Waited 7.55 ms on lock 0x7b4400022b4c. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f287504dc85 00007f287504e6a2 00007f2877dc01db 00007f2877dbbaaf 00007f2877daf86e 00007f2877daebb6 00007f2877dae7d8 00007f2877db8221 00007f2877db81d9 00007f2877db8169
0709 12:26:59.683294 (+  1908us) raft_consensus.cc:1685] finished
0709 12:26:59.683314 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:59.683448 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4027,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":6730,"spinlock_wait_cycles":108856448,"thread_start_us":278076,"threads_started":1,"wal-append.queue_time_us":379137}
I20260709 12:26:59.692107  7205 leader_election.cc:304] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
W20260709 12:26:59.693676  7893 log.cc:927] Time spent T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.567s	user 0.009s	sys 0.002s
I20260709 12:26:59.694033  7673 raft_consensus.cc:2749] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:59.695061  7086 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 159) took 1173 ms. Trace:
I20260709 12:26:59.696278  7862 leader_election.cc:290] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:26:59.695456  7086 rpcz_store.cc:276] 0709 12:26:58.521482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.523927 (+  2445us) service_pool.cc:224] Handling call
0709 12:26:58.597138 (+ 73211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:58.704775 (+107637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:58.712942 (+  8167us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:58.789570 (+ 76628us) log.cc:844] Serialized 26 byte log entry
0709 12:26:59.048720 (+259150us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:59.057905 (+  9185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.100484 (+ 42579us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:59.693064 (+592580us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f287504dc85 00007f287504e6a2 00007f2877dc01db 00007f2877dbbaaf 00007f2877daf86e 00007f2877daebb6 00007f2877dae7d8 00007f2877db8221 00007f2877db81d9 00007f2877db8169
0709 12:26:59.694738 (+  1674us) raft_consensus.cc:1685] finished
0709 12:26:59.694762 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:59.694982 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35280,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8595,"spinlock_wait_cycles":30253312,"thread_start_us":285867,"threads_started":2,"wal-append.queue_time_us":310000}
I20260709 12:26:59.663146  7287 tablet_bootstrap.cc:492] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6: Bootstrap starting.
W20260709 12:26:59.612967  7889 log.cc:927] Time spent T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.480s	user 0.000s	sys 0.013s
I20260709 12:26:59.666608  7231 rpcz_store.cc:276] 0709 12:26:58.651792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.662335 (+ 10543us) service_pool.cc:224] Handling call
0709 12:26:59.665399 (+1003064us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b5800010298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efeee 000000000036eb39 00007f287d1631e0 00007f287d22c0c4 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:26:59.665586 (+   187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.665807 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:59.665835 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:59.665881 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:59.665912 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.665969 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:59.666092 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9489152}
I20260709 12:26:59.702078  7203 leader_election.cc:304] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:59.701606  7055 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:26:59.706681  7203 leader_election.cc:400] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Vote denied by peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437) with higher term. Message: Invalid argument: T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3.
I20260709 12:26:59.685230  7090 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:59.636523  7082 raft_consensus.cc:2410] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:59.705526  7055 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:59.660022  7232 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 5.
I20260709 12:26:59.716588  7284 tablet_bootstrap.cc:654] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.723789  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:59.680233  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:59.725173  7131 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:59.711570  7673 raft_consensus.cc:2804] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.726940  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:59.703212  7880 consensus_queue.cc:1059] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:26:59.733213  7091 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:26:59.731205  7865 raft_consensus.cc:2749] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:59.736841  7128 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:59.726562  7007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34210 (request call id 70) took 1235 ms. Trace:
I20260709 12:26:59.737500  7007 rpcz_store.cc:276] 0709 12:26:58.482749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.497360 (+ 14611us) service_pool.cc:224] Handling call
0709 12:26:59.713910 (+1216550us) spinlock_profiling.cc:243] Waited 80 ms on lock 0x7b5400047c54. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:26:59.718477 (+  4567us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184036224}
I20260709 12:26:59.721809  7690 raft_consensus.cc:2804] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:59.738266  7865 raft_consensus.cc:2749] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:59.739058  7909 raft_consensus.cc:2764] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:26:59.725252  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:59.740347  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:59.740696  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:59.741200  7158 raft_consensus.cc:2393] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 1: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:26:59.741372  7156 raft_consensus.cc:2468] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:26:59.716786  7642 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.742383  7642 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:59.718232  7528 raft_consensus.cc:2764] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:26:59.746994  7203 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:59.812132  7203 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:26:59.813297  6982 leader_election.cc:304] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:59.815002  7091 raft_consensus.cc:1275] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:26:59.820441  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 112259us
W20260709 12:26:59.821062  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 115597us
I20260709 12:26:59.747403  7673 raft_consensus.cc:697] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:26:59.817227  7787 raft_consensus.cc:2749] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:59.817028  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:26:59.820453  7844 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:59.822808  7085 raft_consensus.cc:1275] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:26:59.818401  7690 raft_consensus.cc:697] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:26:59.834928  7164 raft_consensus.cc:1275] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:59.820667  7840 raft_consensus.cc:493] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:59.821843  7835 raft_consensus.cc:493] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:26:59.827508  7723 raft_consensus.cc:493] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.822325  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:26:59.829746  7055 leader_election.cc:304] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:26:59.826483  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:59.830127  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:26:59.850421  7288 tablet_bootstrap.cc:654] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.838770  7085 pending_rounds.cc:85] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca: Aborting all ops after (but not including) 1
I20260709 12:26:59.837864  7086 raft_consensus.cc:3060] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.835315  7845 raft_consensus.cc:2749] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:59.861236  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:59.843528  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:26:59.857934  7085 pending_rounds.cc:107] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:26:59.856467  7838 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.857733  7232 raft_consensus.cc:3060] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.865061  7917 raft_consensus.cc:2749] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:59.855075  7787 raft_consensus.cc:2804] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:26:59.877940  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 45450.5us
I20260709 12:26:59.872833  7285 tablet_bootstrap.cc:492] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:26:59.882871  7285 ts_tablet_manager.cc:1403] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.513s	user 0.021s	sys 0.003s
I20260709 12:26:59.841246  7844 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:59.859988  7880 raft_consensus.cc:493] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:26:59.848147  7840 raft_consensus.cc:515] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:26:59.852264  7723 raft_consensus.cc:515] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:59.848533  7835 raft_consensus.cc:515] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:26:59.872150  7085 raft_consensus.cc:2889] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:59.924041  7787 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:59.931859  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 89630.1us
I20260709 12:26:59.937252  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:26:59.928196  7688 raft_consensus.cc:3060] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:59.944154  7912 log.cc:927] Time spent T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:26:59.874185  7673 consensus_queue.cc:237] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:26:59.939023  7690 consensus_queue.cc:237] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:26:59.946028  7914 log.cc:927] Time spent T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:26:59.946705  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:59.947438  7090 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 5.
I20260709 12:26:59.947590  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:26:59.949940  7013 raft_consensus.cc:1275] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:59.923861  7647 consensus_queue.cc:1048] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:26:59.931257  7880 raft_consensus.cc:515] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:59.932233  7927 raft_consensus.cc:493] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.957782  7723 leader_election.cc:290] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:26:59.958606  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:59.959049  7844 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:26:59.960994  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:26:59.962507  7230 raft_consensus.cc:2468] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:26:59.936581  7787 raft_consensus.cc:3060] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:59.963392  7287 tablet_bootstrap.cc:654] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:00.003196  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 171054us
W20260709 12:27:00.012195  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 67115.3us
I20260709 12:27:00.034440  6982 leader_election.cc:304] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:26:59.874675  7838 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:26:59.999745  7898 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:00.034499  7128 leader_election.cc:304] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:00.025421  7086 raft_consensus.cc:2468] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:27:00.041085  7285 raft_consensus.cc:359] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:00.032990  7927 raft_consensus.cc:515] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:00.051184  7285 raft_consensus.cc:385] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:27:00.052722  6980 leader_election.cc:343] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.048507  7838 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:00.038609  7762 raft_consensus.cc:2764] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:27:00.050431  7898 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:00.051512  7285 raft_consensus.cc:740] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
W20260709 12:27:00.013765  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 201685us
I20260709 12:27:00.059341  7285 consensus_queue.cc:260] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:00.060328  7927 leader_election.cc:290] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:27:00.061771  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 240617us
W20260709 12:27:00.085827  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 51764.9us
I20260709 12:27:00.067034  7642 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:00.093866  7232 raft_consensus.cc:2468] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:27:00.095225  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:00.083271  7840 leader_election.cc:290] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:00.096949  7837 raft_consensus.cc:2749] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:00.108325  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 72510us
I20260709 12:27:00.109650  6982 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:00.069907  7723 consensus_queue.cc:1048] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:27:00.119197  7288 tablet_bootstrap.cc:492] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41: No bootstrap required, opened a new log
I20260709 12:27:00.121869  7288 ts_tablet_manager.cc:1403] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent bootstrapping tablet: real 0.455s	user 0.009s	sys 0.021s
I20260709 12:27:00.076735  7928 raft_consensus.cc:2749] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:00.123420  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:00.123458  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:00.126386  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:00.127349  7016 raft_consensus.cc:2468] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 0.
I20260709 12:27:00.128584  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:00.133924  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:00.134387  7016 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:00.138510  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:00.141965  7054 leader_election.cc:304] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:00.126252  7647 raft_consensus.cc:2804] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:00.145179  7285 ts_tablet_manager.cc:1434] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.262s	user 0.013s	sys 0.015s
I20260709 12:27:00.145481  7054 leader_election.cc:304] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:00.148005  7936 raft_consensus.cc:2804] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:00.148415  7936 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.148761  7936 raft_consensus.cc:3060] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:00.149101  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:00.151096  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:00.153821  7926 raft_consensus.cc:493] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.154986  7131 leader_election.cc:304] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:00.151584  7931 raft_consensus.cc:493] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.159718  7931 raft_consensus.cc:515] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:00.149726  7787 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:00.164242  7880 leader_election.cc:290] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:00.153740  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:00.170563  7284 tablet_bootstrap.cc:492] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:27:00.175417  7284 ts_tablet_manager.cc:1403] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.767s	user 0.027s	sys 0.010s
I20260709 12:27:00.150130  7690 raft_consensus.cc:2804] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:00.176386  7288 raft_consensus.cc:359] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:00.177803  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:00.177991  7288 raft_consensus.cc:385] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.169186  7862 raft_consensus.cc:2804] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:00.180212  7787 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:00.179345  7288 raft_consensus.cc:740] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.201089  7288 consensus_queue.cc:260] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:00.172078  7835 leader_election.cc:290] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:00.182296  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:00.203150  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:00.203533  7288 ts_tablet_manager.cc:1434] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.000s
I20260709 12:27:00.154376  7926 raft_consensus.cc:515] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:00.184302  7087 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 162) took 1374 ms. Trace:
I20260709 12:27:00.196277  7016 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:27:00.177489  7690 raft_consensus.cc:493] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.175789  7647 raft_consensus.cc:697] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:00.204641  7862 raft_consensus.cc:697] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:00.208107  7862 consensus_queue.cc:237] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:00.212422  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:00.217715  7054 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:00.212822  7690 raft_consensus.cc:3060] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.219153  7909 raft_consensus.cc:2749] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:00.220288  7089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 163) took 1409 ms. Trace:
I20260709 12:27:00.220903  7089 rpcz_store.cc:276] 0709 12:26:58.810460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.829969 (+ 19509us) service_pool.cc:224] Handling call
0709 12:27:00.147861 (+1317892us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:00.148069 (+   208us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:00.148493 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.148527 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:00.149039 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:27:00.202657 (+ 53618us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:27:00.202705 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.202782 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:00.219863 (+ 17081us) raft_consensus.cc:1685] finished
0709 12:27:00.219895 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.220209 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1134,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":2827520,"thread_start_us":53132,"threads_started":1,"wal-append.queue_time_us":53524}
I20260709 12:27:00.226055  7942 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:00.228390  7789 leader_election.cc:290] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:00.226706  7942 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:00.228976  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:00.233186  7163 raft_consensus.cc:2468] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:00.233927  7055 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:00.236923  7055 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:00.238672  7284 raft_consensus.cc:359] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:00.239773  7284 raft_consensus.cc:385] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.205569  7087 rpcz_store.cc:276] 0709 12:26:58.810182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.858579 (+ 48397us) service_pool.cc:224] Handling call
0709 12:27:00.183491 (+1324912us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:00.183700 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.183894 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.183923 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:00.183992 (+    69us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:00.184041 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.184108 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.184226 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38288128}
I20260709 12:27:00.240113  7284 raft_consensus.cc:740] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.243335  7284 consensus_queue.cc:260] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:00.249209  7880 raft_consensus.cc:2804] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:00.249804  7880 raft_consensus.cc:697] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:00.250104  7842 raft_consensus.cc:3055] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:00.250520  7842 raft_consensus.cc:740] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:00.250761  7880 consensus_queue.cc:237] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:00.251382  7842 consensus_queue.cc:260] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:00.254017  7926 leader_election.cc:290] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:00.254814  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:00.255249  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:00.256073  7160 raft_consensus.cc:2393] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 1: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:00.256732  7898 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:00.252415  7842 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:00.257957  7284 ts_tablet_manager.cc:1434] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.082s	user 0.004s	sys 0.002s
I20260709 12:27:00.258874  7287 tablet_bootstrap.cc:492] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6: No bootstrap required, opened a new log
I20260709 12:27:00.259362  7287 ts_tablet_manager.cc:1403] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6: Time spent bootstrapping tablet: real 0.606s	user 0.021s	sys 0.003s
I20260709 12:27:00.267443  7284 tablet_bootstrap.cc:492] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:27:00.267915  7055 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
W20260709 12:27:00.271377  7055 leader_election.cc:343] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.274580  7909 consensus_queue.cc:1048] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.275211  7287 raft_consensus.cc:359] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:00.275929  7287 raft_consensus.cc:385] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.276217  7287 raft_consensus.cc:740] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.277946  7287 consensus_queue.cc:260] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:00.281441  7287 ts_tablet_manager.cc:1434] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:27:00.272290  7642 raft_consensus.cc:2804] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:00.282814  7642 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.282670  7647 consensus_queue.cc:237] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:00.283214  7642 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:00.269591  7789 raft_consensus.cc:2749] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:00.302196  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 161426us
I20260709 12:27:00.305680  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:00.306756  7016 raft_consensus.cc:2468] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:00.288937  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:00.319574  7202 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:00.324144  7014 raft_consensus.cc:1275] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:00.323112  7202 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:00.337486  7285 tablet_bootstrap.cc:492] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:27:00.340603  7159 raft_consensus.cc:1275] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:00.341207  7787 raft_consensus.cc:2804] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:00.341639  7787 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:00.342036  7787 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:00.343278  7645 consensus_queue.cc:1048] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:00.302028  7936 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:00.345844  7762 raft_consensus.cc:2804] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:00.321671  7084 raft_consensus.cc:2468] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:27:00.356317  7128 leader_election.cc:304] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:00.359169  7128 leader_election.cc:304] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:00.357499  7842 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:00.365509  7929 raft_consensus.cc:2749] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:00.529914  7056 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.342002  7690 raft_consensus.cc:515] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:00.574975  7892 raft_consensus.cc:493] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.581794  7892 raft_consensus.cc:515] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:00.550724  7903 raft_consensus.cc:2749] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:00.363343  7649 consensus_queue.cc:1048] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.210s
I20260709 12:27:00.549662  7762 raft_consensus.cc:697] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:00.560837  7564 raft_consensus.cc:493] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.592489  7892 leader_election.cc:290] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:00.608071  7670 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:27:00.612478  7205 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.067s	sys 0.055s
I20260709 12:27:00.573580  7673 raft_consensus.cc:493] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.617766  7943 raft_consensus.cc:493] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.617885  7673 raft_consensus.cc:515] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:00.619091  7945 log.cc:927] Time spent T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.431s	user 0.006s	sys 0.004s
I20260709 12:27:00.618300  7943 raft_consensus.cc:515] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:00.616650  7203 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.059s	sys 0.093s
W20260709 12:27:00.622361  7203 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.059s	sys 0.093s
I20260709 12:27:00.574314  7842 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:00.626219  7205 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.068s	sys 0.055s
W20260709 12:27:00.627048  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 542943us
I20260709 12:27:00.631294  7205 leader_election.cc:304] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:00.635135  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:00.635877  7010 raft_consensus.cc:3060] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:00.637176  7642 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:00.640324  7285 tablet_bootstrap.cc:654] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.640743  7762 consensus_queue.cc:237] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:00.626009  7673 leader_election.cc:290] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:00.645152  7842 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:00.645246  7642 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:00.647953  6982 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:00.674379  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:00.624176  7084 raft_consensus.cc:1240] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:00.652977  7924 raft_consensus.cc:2749] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:00.653029  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:00.654120  7936 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:00.656051  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:00.661329  7690 leader_election.cc:290] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:00.662506  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:00.668782  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:00.623319  7670 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:00.675330  7013 raft_consensus.cc:2468] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:27:00.621587  7564 raft_consensus.cc:515] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:00.683733  7203 leader_election.cc:304] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:00.694422  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:00.671628  7865 raft_consensus.cc:493] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.681149  7844 raft_consensus.cc:2749] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:00.701329  7203 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:00.702692  7284 tablet_bootstrap.cc:654] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.705374  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:00.705514  7055 leader_election.cc:343] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.687601  7159 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:00.707700  7128 leader_election.cc:304] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:00.727180  6980 leader_election.cc:304] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:00.707069  7959 log.cc:927] Time spent T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:27:00.732194  7961 log.cc:927] Time spent T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:27:00.734195  7892 raft_consensus.cc:2749] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:00.732234  7787 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:00.702154  7942 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:00.699831  7924 raft_consensus.cc:2749] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:00.697068  7012 raft_consensus.cc:2468] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:00.752961  6982 leader_election.cc:304] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:00.745889  7787 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:00.746922  7010 raft_consensus.cc:2468] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:00.704501  7865 raft_consensus.cc:515] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:00.744452  7754 consensus_queue.cc:1048] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:27:00.754096  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 51651.4us
I20260709 12:27:00.754262  6982 leader_election.cc:304] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:00.760779  7203 leader_election.cc:304] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
W20260709 12:27:00.761339  6982 leader_election.cc:343] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.762301  6982 leader_election.cc:304] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:00.729079  7936 raft_consensus.cc:493] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.730983  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:00.758091  7928 raft_consensus.cc:2749] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:00.744517  7930 raft_consensus.cc:2804] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:00.765949  7787 raft_consensus.cc:2749] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:00.772310  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:00.799635  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:00.771610  7955 log.cc:927] Time spent T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:27:00.772135  7960 log.cc:927] Time spent T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:27:00.766862  7845 raft_consensus.cc:2749] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:00.800467  7239 raft_consensus.cc:2468] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
W20260709 12:27:00.772799  7958 log.cc:927] Time spent T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:27:00.772495  7892 raft_consensus.cc:2749] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:00.768527  7963 raft_consensus.cc:2749] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:00.770988  7943 leader_election.cc:290] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:00.771234  7924 consensus_queue.cc:1048] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:27:00.774763  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:00.824203  7670 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:00.824223  7928 raft_consensus.cc:493] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:00.824309  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:00.825127  7928 raft_consensus.cc:515] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:00.773137  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:00.771078  7234 raft_consensus.cc:2468] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:27:00.819123  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:00.827282  7928 leader_election.cc:290] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:00.827499  7239 raft_consensus.cc:3060] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:00.827783  7928 raft_consensus.cc:493] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:00.770921  7159 raft_consensus.cc:2468] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:00.828765  7238 raft_consensus.cc:1240] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:00.831557  7865 leader_election.cc:290] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:00.772254  7936 raft_consensus.cc:515] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:00.834808  7936 leader_election.cc:290] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:00.799795  7930 raft_consensus.cc:493] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.836400  7930 raft_consensus.cc:3060] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.836751  7239 raft_consensus.cc:2468] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:00.838008  6980 leader_election.cc:304] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:00.849195  7754 raft_consensus.cc:2804] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:00.849766  7754 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.850193  7754 raft_consensus.cc:3060] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.857152  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:00.862600  7564 leader_election.cc:290] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:00.867703  7156 raft_consensus.cc:1275] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:27:00.875949  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 112324us
W20260709 12:27:00.925673  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 43531.7us
I20260709 12:27:00.963112  7165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56794 (request call id 162) took 1252 ms. Trace:
I20260709 12:27:00.966449  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:00.967382  7239 raft_consensus.cc:2468] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:27:00.828280  7928 raft_consensus.cc:515] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:00.959421  7156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56784 (request call id 110) took 1212 ms. Trace:
I20260709 12:27:01.005559  7165 rpcz_store.cc:276] 0709 12:26:59.711248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.712152 (+   904us) service_pool.cc:224] Handling call
0709 12:27:00.957764 (+1245612us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:00.958050 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.958287 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.961168 (+  2881us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:00.961473 (+   305us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:00.961527 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.961615 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.963033 (+  1418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2585856}
I20260709 12:27:00.869822  7931 leader_election.cc:290] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:00.960327  7739 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.959635  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:00.957417  7865 consensus_queue.cc:1048] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.060s
I20260709 12:27:01.039810  6980 leader_election.cc:304] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:01.011577  7927 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:01.049005  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:00.963001  7647 consensus_queue.cc:1059] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:27:01.011468  7943 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.022719  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:01.049715  7239 raft_consensus.cc:2468] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:27:01.047739  7845 raft_consensus.cc:493] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:01.036617  7739 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:01.065438  6980 leader_election.cc:304] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:01.067747  7235 raft_consensus.cc:1240] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:01.076440  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:01.078842  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:01.079804  7236 raft_consensus.cc:2468] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:27:01.085242  7284 tablet_bootstrap.cc:492] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:27:01.085506  7739 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:01.085830  7284 ts_tablet_manager.cc:1403] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.827s	user 0.067s	sys 0.128s
I20260709 12:27:01.088804  7284 raft_consensus.cc:359] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:01.089792  7284 raft_consensus.cc:385] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.090080  7284 raft_consensus.cc:740] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.090113  7233 raft_consensus.cc:1275] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:01.090792  7284 consensus_queue.cc:260] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:01.093770  7284 ts_tablet_manager.cc:1434] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:01.097412  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:01.060426  7971 raft_consensus.cc:2804] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:01.015794  7156 rpcz_store.cc:276] 0709 12:26:59.744340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.746226 (+  1886us) service_pool.cc:224] Handling call
0709 12:27:00.866924 (+1120698us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:00.867208 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.868314 (+  1106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.927595 (+ 59281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32847744}
I20260709 12:27:01.053113  7927 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:01.111598  7284 tablet_bootstrap.cc:492] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:27:01.108309  7971 raft_consensus.cc:493] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.116760  7971 raft_consensus.cc:3060] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.116962  7892 raft_consensus.cc:2804] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:01.117666  7892 raft_consensus.cc:493] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.118119  7892 raft_consensus.cc:3060] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:01.120463  7056 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.075078  7845 raft_consensus.cc:515] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:01.112896  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:01.123138  7008 raft_consensus.cc:3060] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.132360  7892 raft_consensus.cc:515] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:01.134087  7089 raft_consensus.cc:1275] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:01.057766  7943 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:01.139792  7285 tablet_bootstrap.cc:492] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:27:01.150413  7285 ts_tablet_manager.cc:1403] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.818s	user 0.033s	sys 0.035s
W20260709 12:27:01.149456  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 84091us
I20260709 12:27:01.131865  7930 raft_consensus.cc:515] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:01.162899  7285 raft_consensus.cc:359] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:01.157941  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:01.137843  7928 leader_election.cc:290] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:01.161382  7936 raft_consensus.cc:493] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:01.163798  7963 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.155570  7055 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:01.165858  7285 raft_consensus.cc:385] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.173203  7285 raft_consensus.cc:740] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.174232  7285 consensus_queue.cc:260] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:01.157281  7156 raft_consensus.cc:1275] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:01.136912  7235 raft_consensus.cc:1275] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:01.179390  7963 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:01.181840  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:01.167196  7931 raft_consensus.cc:493] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.184850  7236 raft_consensus.cc:1240] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:01.178999  7936 raft_consensus.cc:515] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:01.186476  7943 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:01.191390  7008 raft_consensus.cc:2468] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:27:01.192821  7842 raft_consensus.cc:2804] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:01.194165  7927 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:01.195164  7285 ts_tablet_manager.cc:1434] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.001s
I20260709 12:27:01.195359  7845 leader_election.cc:290] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:01.196589  7898 raft_consensus.cc:493] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:01.194098  7055 leader_election.cc:304] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:01.196920  7857 consensus_queue.cc:1048] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:01.198164  7930 leader_election.cc:290] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:01.200193  7928 consensus_queue.cc:1048] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:01.202833  7963 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:01.205474  7971 raft_consensus.cc:515] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:01.207108  7754 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:01.135150  7892 leader_election.cc:290] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:01.211114  7284 tablet_bootstrap.cc:654] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.211519  7232 raft_consensus.cc:2468] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 0.
I20260709 12:27:01.252604  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:01.263178  7016 raft_consensus.cc:2393] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 1: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
W20260709 12:27:01.253091  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 59096.2us
I20260709 12:27:01.212941  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:01.264026  7162 raft_consensus.cc:2468] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:27:01.264194  7055 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:01.259452  7285 tablet_bootstrap.cc:492] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:27:01.268383  7055 leader_election.cc:304] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:01.285809  7936 leader_election.cc:290] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:01.286517  7232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49174 (request call id 163) took 1178 ms. Trace:
I20260709 12:27:01.257268  7898 raft_consensus.cc:515] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:01.287112  7232 rpcz_store.cc:276] 0709 12:27:00.098021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.115062 (+ 17041us) service_pool.cc:224] Handling call
0709 12:27:01.211329 (+1096267us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b54005673a8. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287dfefab1 00007f287dff15f4 00007f287d1da227 00007f287d1d9ab8 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6
0709 12:27:01.268254 (+ 56925us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82633600}
I20260709 12:27:01.256796  7842 raft_consensus.cc:697] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:01.258754  7642 raft_consensus.cc:2749] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:01.244382  7931 raft_consensus.cc:515] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:01.320706  7128 leader_election.cc:304] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
W20260709 12:27:01.291173  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 139117us
I20260709 12:27:01.347807  6980 leader_election.cc:304] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:01.348955  7054 leader_election.cc:304] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
W20260709 12:27:01.352311  6982 leader_election.cc:343] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.353781  7857 raft_consensus.cc:493] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:01.354430  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:01.354538  7857 raft_consensus.cc:515] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:01.355343  7082 raft_consensus.cc:2468] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:27:01.356815  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:01.357470  7862 raft_consensus.cc:2804] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:01.357893  7862 raft_consensus.cc:493] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.358027  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:01.358357  7862 raft_consensus.cc:3060] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:01.358798  7013 raft_consensus.cc:2393] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 3: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:01.359329  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:01.359927  7013 raft_consensus.cc:1275] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:01.270493  7163 raft_consensus.cc:2393] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 1: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:01.361896  7285 tablet_bootstrap.cc:654] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.269582  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:01.288982  7883 raft_consensus.cc:2804] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:01.286561  7936 raft_consensus.cc:2804] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:01.382380  7957 raft_consensus.cc:493] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.317705  7898 leader_election.cc:290] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:01.313319  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:01.318621  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:01.309870  7971 leader_election.cc:290] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:01.323534  7754 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:01.316869  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:01.366181  7844 raft_consensus.cc:2804] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:01.374217  7929 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:01.405051  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:01.405790  7016 raft_consensus.cc:2468] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:01.353785  7981 consensus_queue.cc:1048] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:27:01.390781  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:01.422343  6980 leader_election.cc:304] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:01.393666  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:01.404275  7844 raft_consensus.cc:493] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:01.394750  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:01.385516  7883 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:27:01.453730  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 104871us
I20260709 12:27:01.407805  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:01.395774  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:01.399305  7927 raft_consensus.cc:493] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:01.397306  7936 raft_consensus.cc:697] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:01.438105  7230 raft_consensus.cc:1275] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:01.447222  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:01.456875  6982 leader_election.cc:304] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:01.405385  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:01.428258  7754 consensus_queue.cc:1059] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:27:01.454999  7164 raft_consensus.cc:2393] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 3: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:01.459371  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:01.451820  7844 raft_consensus.cc:3060] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:01.400640  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:01.437875  7931 leader_election.cc:290] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:01.456084  7845 raft_consensus.cc:2804] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:01.396368  7957 raft_consensus.cc:515] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:01.456470  7883 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:01.452903  7232 raft_consensus.cc:3060] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.458304  7233 raft_consensus.cc:3060] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.404173  7010 raft_consensus.cc:2468] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 0.
I20260709 12:27:01.478816  7015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 167) took 1643 ms. Trace:
I20260709 12:27:01.480988  7088 raft_consensus.cc:1275] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
W20260709 12:27:01.491307  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 223275us
I20260709 12:27:01.479403  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:01.466645  7690 raft_consensus.cc:2804] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:01.407502  7842 consensus_queue.cc:237] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:01.478634  7984 raft_consensus.cc:2804] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:01.473974  7238 raft_consensus.cc:3060] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:01.476810  7163 raft_consensus.cc:3060] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.481923  7089 raft_consensus.cc:2468] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:01.469767  7937 raft_consensus.cc:493] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:01.501130  7164 raft_consensus.cc:1240] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:27:01.485491  7162 raft_consensus.cc:2393] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 1: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:01.490293  7015 rpcz_store.cc:276] 0709 12:26:59.848401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.853159 (+  4758us) service_pool.cc:224] Handling call
0709 12:26:59.853455 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.937479 (+ 84024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:59.937509 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:59.937549 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:59.937576 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.478596 (+1541020us) spinlock_profiling.cc:243] Waited 83.8 ms on lock 0x7b5400595bd4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:01.478644 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:01.478762 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192816512}
I20260709 12:27:01.408360  7929 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:01.493966  7203 leader_election.cc:304] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:01.462862  7647 consensus_queue.cc:1048] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:27:01.477720  7845 raft_consensus.cc:493] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.464816  7927 raft_consensus.cc:515] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:01.494844  6982 leader_election.cc:343] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.490346  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:01.497357  7971 consensus_queue.cc:1048] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:27:01.503137  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:01.508716  7012 raft_consensus.cc:1275] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:01.517026  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:01.556164  7010 raft_consensus.cc:2393] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 1: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:01.521101  7931 raft_consensus.cc:493] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:01.557168  7931 raft_consensus.cc:515] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:01.558775  7056 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.559321  7931 leader_election.cc:290] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:01.559790  7990 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.523150  7284 tablet_bootstrap.cc:492] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:27:01.560508  7284 ts_tablet_manager.cc:1403] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.456s	user 0.019s	sys 0.011s
I20260709 12:27:01.560297  7990 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:01.562459  7990 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:01.563058  7990 consensus_queue.cc:1048] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:01.524878  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:01.531327  7937 raft_consensus.cc:515] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:01.564459  7844 raft_consensus.cc:515] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:01.536221  7128 leader_election.cc:304] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:01.498622  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:01.497161  7857 leader_election.cc:290] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:01.494247  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:01.553354  7927 leader_election.cc:290] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:01.554349  7951 consensus_queue.cc:1048] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:01.547024  7845 raft_consensus.cc:3060] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:01.538945  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 44134.2us
I20260709 12:27:01.498157  7984 raft_consensus.cc:493] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:01.568090  7203 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:01.563791  7284 raft_consensus.cc:359] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:01.595170  7284 raft_consensus.cc:385] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.595561  7284 raft_consensus.cc:740] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.521588  7936 consensus_queue.cc:237] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:01.600245  7284 consensus_queue.cc:260] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:01.549890  7528 consensus_queue.cc:1059] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:27:01.606101  7158 raft_consensus.cc:2393] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 3: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:01.607026  7857 raft_consensus.cc:493] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:01.607748  7857 raft_consensus.cc:515] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:01.610276  7857 leader_election.cc:290] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:01.612762  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:01.613637  7230 raft_consensus.cc:2468] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:01.596659  7087 raft_consensus.cc:2468] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 0.
I20260709 12:27:01.615118  6980 leader_election.cc:304] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:01.616439  7892 raft_consensus.cc:2804] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:01.616889  7892 raft_consensus.cc:493] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:01.617215  7892 raft_consensus.cc:3060] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:01.585285  7930 raft_consensus.cc:2804] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:01.618072  7930 raft_consensus.cc:493] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.618487  7862 raft_consensus.cc:515] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:01.622514  7011 raft_consensus.cc:2468] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:01.622946  7929 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:27:01.537345  7762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.008s	sys 0.051s
I20260709 12:27:01.633122  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:01.645628  7165 raft_consensus.cc:2468] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:01.636200  7284 ts_tablet_manager.cc:1434] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.000s
I20260709 12:27:01.651674  7927 raft_consensus.cc:493] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.651472  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:01.652251  7927 raft_consensus.cc:515] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:01.653918  7844 leader_election.cc:290] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:01.654424  7927 leader_election.cc:290] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:01.638185  7238 raft_consensus.cc:2468] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:01.656121  6980 leader_election.cc:304] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:01.637974  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:01.656921  7844 raft_consensus.cc:2804] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:01.632688  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:01.657431  7857 raft_consensus.cc:493] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:01.657653  7844 raft_consensus.cc:697] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:01.641315  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:01.649372  7762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.009s	sys 0.052s
I20260709 12:27:01.588425  7993 consensus_queue.cc:1048] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 12:27:01.626703  7202 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:01.656853  7673 raft_consensus.cc:3055] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:01.598152  7984 raft_consensus.cc:3060] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:01.684906  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 192945us
W20260709 12:27:01.686141  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 59567us
W20260709 12:27:01.695948  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 225609us
I20260709 12:27:01.630656  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:01.618517  7930 raft_consensus.cc:3060] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:01.683744  7009 raft_consensus.cc:3060] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:01.681885  7690 raft_consensus.cc:697] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:01.685505  7865 raft_consensus.cc:493] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.685249  7673 raft_consensus.cc:740] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:01.661106  7233 raft_consensus.cc:2468] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:27:01.693178  7739 raft_consensus.cc:2804] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:01.626250  7883 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:01.602662  7963 consensus_queue.cc:1048] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 12:27:01.689379  7862 leader_election.cc:290] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:01.730333  7234 raft_consensus.cc:2393] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 3: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:01.658020  7857 raft_consensus.cc:515] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:01.731886  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:01.710425  7232 raft_consensus.cc:2468] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:27:01.730765  7156 raft_consensus.cc:3060] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:01.733793  7937 leader_election.cc:290] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:27:01.815433  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 130568us
I20260709 12:27:01.793483  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:01.783394  7670 consensus_queue.cc:1048] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:27:01.809793  7087 raft_consensus.cc:3060] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.809298  7645 raft_consensus.cc:2749] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:01.774555  7865 raft_consensus.cc:515] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:01.807852  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:01.824654  7937 raft_consensus.cc:493] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:01.823752  7957 leader_election.cc:290] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:01.819283  7898 raft_consensus.cc:493] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:01.824882  7688 raft_consensus.cc:493] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:01.850857  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:01.851408  7937 raft_consensus.cc:515] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:01.786166  7844 consensus_queue.cc:237] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:01.825246  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:01.859254  7883 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:01.860157  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 191657us
I20260709 12:27:01.892928  7128 leader_election.cc:304] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:01.834012  7996 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.838411  7083 raft_consensus.cc:2393] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 3: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:01.823547  7845 raft_consensus.cc:515] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:01.849112  7998 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:27:01.888252  7055 leader_election.cc:343] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.862757  7842 consensus_queue.cc:1059] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:27:01.828282  7673 consensus_queue.cc:260] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:01.873713  7234 raft_consensus.cc:2468] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:01.839164  7690 consensus_queue.cc:237] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:01.911341  7838 raft_consensus.cc:3055] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:01.867444  7688 raft_consensus.cc:515] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:01.966362  8009 raft_consensus.cc:493] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.955195  7233 raft_consensus.cc:2393] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 1: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:01.870483  7898 raft_consensus.cc:515] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:01.918236  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:02.000514  7285 tablet_bootstrap.cc:492] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
I20260709 12:27:02.001323  7285 ts_tablet_manager.cc:1403] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 0.749s	user 0.030s	sys 0.053s
I20260709 12:27:01.912043  7996 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:02.014837  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:01.962602  7231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49160 (request call id 137) took 1267 ms. Trace:
I20260709 12:27:02.016420  7231 rpcz_store.cc:276] 0709 12:27:00.690653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.691778 (+  1125us) service_pool.cc:224] Handling call
0709 12:27:01.202827 (+511049us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b5800010298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:01.203068 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.343160 (+140092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:01.347788 (+  4628us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:01.367199 (+ 19411us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:01.372007 (+  4808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.917248 (+545241us) spinlock_profiling.cc:243] Waited 87.6 ms on lock 0x7b54003eba54. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:01.923344 (+  6096us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:01.958432 (+ 35088us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210662016}
W20260709 12:27:02.020582  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 323807us
I20260709 12:27:02.026005  7054 leader_election.cc:304] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
W20260709 12:27:02.031678  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 156925us
W20260709 12:27:02.032155  6982 leader_election.cc:343] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.964494  7838 raft_consensus.cc:740] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:02.045873  6980 leader_election.cc:304] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:01.967852  7990 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:02.051333  6982 leader_election.cc:304] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:02.053525  6982 leader_election.cc:304] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:01.987069  7673 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:02.055176  7205 leader_election.cc:304] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:02.060911  6980 leader_election.cc:304] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:01.913096  7998 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:02.074874  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:02.042569  7842 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:02.100751  7129 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
W20260709 12:27:02.114096  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 192925us
I20260709 12:27:02.064275  7647 raft_consensus.cc:2804] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:02.072572  7754 raft_consensus.cc:2804] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:02.130821  8010 raft_consensus.cc:493] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:02.064704  7985 raft_consensus.cc:2804] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:02.103495  7971 raft_consensus.cc:2804] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:02.042526  7930 raft_consensus.cc:515] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:01.993042  8009 raft_consensus.cc:515] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:02.152024  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 51423.3us
I20260709 12:27:02.098294  7857 leader_election.cc:290] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:02.131315  7838 consensus_queue.cc:260] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:02.056958  7928 consensus_queue.cc:1048] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:27:02.057097  7990 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:02.137998  7285 raft_consensus.cc:359] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:02.155347  7010 raft_consensus.cc:1240] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:02.159240  7985 raft_consensus.cc:493] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:02.173187  7285 raft_consensus.cc:385] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:02.164433  7129 leader_election.cc:304] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:02.173408  7985 raft_consensus.cc:3060] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:02.173543  7285 raft_consensus.cc:740] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.174329  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:02.174787  7285 consensus_queue.cc:260] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:02.175961  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:02.176856  7838 raft_consensus.cc:3060] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:02.158773  8010 raft_consensus.cc:515] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:02.181869  7990 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:02.150246  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:02.129657  7842 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:02.196787  8029 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.196947  7963 raft_consensus.cc:2749] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:02.197541  7688 leader_election.cc:290] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:02.198088  7650 raft_consensus.cc:2804] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:02.196816  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:02.106647  8012 consensus_queue.cc:1048] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:27:02.165591  8022 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.141825  7647 raft_consensus.cc:493] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.200459  7164 raft_consensus.cc:2368] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4.
W20260709 12:27:02.221433  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 153410us
I20260709 12:27:02.190074  7865 leader_election.cc:290] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:27:02.203323  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 128774us
I20260709 12:27:02.171633  7971 raft_consensus.cc:697] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
W20260709 12:27:02.196897  7999 log.cc:927] Time spent T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 12:27:02.205792  7943 raft_consensus.cc:2749] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:02.199862  7009 raft_consensus.cc:2468] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
W20260709 12:27:02.223096  6980 leader_election.cc:343] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.224226  7203 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:02.197005  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:02.206887  7956 raft_consensus.cc:2749] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:02.196424  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:02.206791  7857 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:02.224371  7647 raft_consensus.cc:3060] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:02.205261  7937 leader_election.cc:290] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:27:02.241375  8000 log.cc:927] Time spent T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 12:27:02.207350  7650 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:02.214203  7990 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:02.217696  8016 raft_consensus.cc:2804] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:02.258073  8016 raft_consensus.cc:493] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.258457  8016 raft_consensus.cc:3060] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:02.214449  7010 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:02.249989  8004 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:02.237975  8003 log.cc:927] Time spent T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:27:02.207299  7845 leader_election.cc:290] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:02.223654  7928 raft_consensus.cc:493] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:02.199709  8014 consensus_queue.cc:1059] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:27:02.257403  8026 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:02.257217  7990 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:02.206967  8029 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:02.218479  8025 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:02.257462  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:02.262307  8008 raft_consensus.cc:493] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:02.223640  8022 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:02.263756  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:02.262212  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:02.264351  8010 leader_election.cc:290] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:02.264748  7898 leader_election.cc:290] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:02.301219  7996 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:02.301928  7009 raft_consensus.cc:2393] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 1: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:02.303390  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:02.256932  7650 raft_consensus.cc:3060] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:02.262202  8002 log.cc:927] Time spent T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 12:27:02.280211  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:02.284267  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:02.286900  7085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 174) took 3002 ms. Trace:
W20260709 12:27:02.294003  8019 log.cc:927] Time spent T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:27:02.254937  7857 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:02.296661  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 50033.1us
I20260709 12:27:02.273656  8026 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:02.326619  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:02.269378  8004 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:02.321210  7085 rpcz_store.cc:276] 0709 12:26:59.285012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.667924 (+382912us) service_pool.cc:224] Handling call
0709 12:26:59.718244 (+ 50320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.963145 (+244901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.384373 (+1421228us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b5400460854. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:02.286660 (+902287us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b5400460850. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782138ad 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:02.286811 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176246784}
I20260709 12:27:02.274106  7928 raft_consensus.cc:515] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:02.329239  7203 leader_election.cc:304] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:02.331424  7284 tablet_bootstrap.cc:492] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:27:02.335440  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:02.305682  8010 raft_consensus.cc:493] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:02.317066  7996 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.327682  7930 leader_election.cc:290] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:02.304359  8016 raft_consensus.cc:515] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:02.275851  7971 consensus_queue.cc:237] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:02.361565  7857 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:02.352962  7892 consensus_meta.cc:287] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.001s
I20260709 12:27:02.350986  7898 raft_consensus.cc:2749] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:02.297706  8025 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:02.368328  7928 leader_election.cc:290] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:02.370570  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:02.348194  7998 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:02.385324  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:02.363889  8029 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:02.355216  8010 raft_consensus.cc:515] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:02.395356  8010 leader_election.cc:290] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:02.395730  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:02.396953  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:02.397456  7165 raft_consensus.cc:3060] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:02.354305  7996 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:02.420954  7087 consensus_meta.cc:287] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.001s
I20260709 12:27:02.421321  7842 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:02.422303  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:02.305471  8008 raft_consensus.cc:515] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:02.373593  7892 raft_consensus.cc:515] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:02.438469  8016 leader_election.cc:290] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:02.424793  8032 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:02.416486  8025 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:02.447189  8032 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:02.453673  7165 raft_consensus.cc:2468] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:27:02.463373  6980 leader_election.cc:304] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
W20260709 12:27:02.528649  6982 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:02.535951  6981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.538166  7284 tablet_bootstrap.cc:654] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:02.540649  7883 raft_consensus.cc:493] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.566586  8026 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:02.616072  7865 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:02.633621  7865 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:02.534190  7930 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:02.543058  7838 raft_consensus.cc:2804] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:02.542593  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:02.447762  8008 leader_election.cc:290] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:02.543496  8022 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:27:02.635162  7673 consensus_meta.cc:287] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
I20260709 12:27:02.649988  8032 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:02.541193  7883 raft_consensus.cc:515] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:02.684665  8004 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:27:02.723080  7984 consensus_meta.cc:287] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 1.020s	user 0.012s	sys 0.002s
I20260709 12:27:02.723701  7984 raft_consensus.cc:515] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:02.725178  7013 raft_consensus.cc:1240] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:02.785673  7981 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:02.786561  7981 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:02.640889  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 476566us
I20260709 12:27:02.811573  7232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49174 (request call id 186) took 1172 ms. Trace:
I20260709 12:27:02.812165  7232 rpcz_store.cc:276] 0709 12:27:01.639330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.834242 (+194912us) service_pool.cc:224] Handling call
0709 12:27:01.868155 (+ 33913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.098984 (+230829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.102826 (+  3842us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.113731 (+ 10905us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:02.126834 (+ 13103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.811303 (+684469us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54003e3354. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:02.811350 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.811490 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426670464}
W20260709 12:27:02.814494  7285 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.004s	sys 0.014s
W20260709 12:27:02.814881  7285 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.004s	sys 0.014s
I20260709 12:27:02.815902  7285 ts_tablet_manager.cc:1434] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.814s	user 0.011s	sys 0.015s
W20260709 12:27:02.816332  7285 ts_tablet_manager.cc:1467] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b: Tablet startup took 814ms
W20260709 12:27:02.816606  7285 ts_tablet_manager.cc:1469] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b: Trace:
0709 12:26:44.235336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.061970 (+826634us) service_pool.cc:224] Handling call
0709 12:26:45.139803 (+ 77833us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:26:45.139917 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:26:45.351647 (+211730us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:45.408139 (+ 56492us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:45.408612 (+   473us) inbound_call.cc:177] Queueing success response
0709 12:27:01.248359 (+15839747us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:27:02.001666 (+753307us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:27:02.017569 (+ 15903us) tablet_replica.cc:261] Starting instrumentation
0709 12:27:02.019195 (+  1626us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":62908,"raft.queue_time_us":29610,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":12199,"tablet-open.queue_time_us":15839842,"thread_start_us":639100,"threads_started":1}
I20260709 12:27:02.819003  7285 tablet_bootstrap.cc:492] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b: Bootstrap starting.
I20260709 12:27:02.818881  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
W20260709 12:27:02.821286  7131 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.001s	sys 0.015s
W20260709 12:27:02.821666  7131 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.001s	sys 0.015s
W20260709 12:27:02.821940  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 680451us
I20260709 12:27:02.822642  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:02.826128  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.825973  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:02.827040  8033 raft_consensus.cc:493] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:02.827811  8033 raft_consensus.cc:515] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:02.830649  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:02.830817  8033 leader_election.cc:290] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:02.835400  8009 leader_election.cc:290] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:02.841670  8001 log.cc:927] Time spent T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.852s	user 0.005s	sys 0.006s
I20260709 12:27:02.843796  8020 raft_consensus.cc:3055] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:02.855298  7082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 189) took 1164 ms. Trace:
W20260709 12:27:02.870134  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:02.879588  7762 raft_consensus.cc:3055] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:27:02.896987  7156 consensus_meta.cc:287] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 1.074s	user 0.010s	sys 0.003s
I20260709 12:27:02.885361  7990 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:02.886499  7083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46252 (request call id 186) took 1196 ms. Trace:
I20260709 12:27:02.891688  7883 leader_election.cc:290] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:02.895743  7233 raft_consensus.cc:1240] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:27:02.658892  7930 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:02.978158  7885 raft_consensus.cc:493] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:02.696570  7838 raft_consensus.cc:697] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:02.899725  8028 raft_consensus.cc:493] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:02.939503  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:02.942301  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:02.882835  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:02.970358  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:02.974740  7083 rpcz_store.cc:276] 0709 12:27:01.689741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.693161 (+  3420us) service_pool.cc:224] Handling call
0709 12:27:02.886242 (+1193081us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5400474fd4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:02.886408 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26681600}
I20260709 12:27:02.988919  7993 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:02.974779  7996 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:02.989396  8012 raft_consensus.cc:493] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:02.972784  7156 raft_consensus.cc:2468] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:27:02.973165  7285 tablet_bootstrap.cc:654] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:02.978705  7885 raft_consensus.cc:515] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:02.985088  7165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56794 (request call id 193) took 1017 ms. Trace:
I20260709 12:27:02.968735  7762 raft_consensus.cc:740] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:02.987756  7838 consensus_queue.cc:237] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:02.988243  7160 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:02.979790  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:02.973742  8020 raft_consensus.cc:740] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
W20260709 12:27:02.997754  7054 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.044s	sys 0.062s
I20260709 12:27:02.998200  7165 rpcz_store.cc:276] 0709 12:27:01.967984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.533679 (+565695us) service_pool.cc:224] Handling call
0709 12:27:02.939272 (+405593us) spinlock_profiling.cc:243] Waited 8.84 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:02.985012 (+ 45740us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20336000}
W20260709 12:27:02.998031  7163 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.010s	sys 0.022s
I20260709 12:27:02.971650  7865 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:27:03.005005  7205 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.013s	sys 0.020s
W20260709 12:27:03.008922  7205 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.013s	sys 0.020s
W20260709 12:27:03.007346  7054 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.045s	sys 0.062s
W20260709 12:27:03.008692  7163 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.010s	sys 0.022s
I20260709 12:27:02.990329  7156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56794 (request call id 176) took 1585 ms. Trace:
W20260709 12:27:03.009338  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 875484us
I20260709 12:27:03.001914  8028 raft_consensus.cc:515] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:03.021163  7055 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:03.006141  7930 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:27:03.009205  7754 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.042s	sys 0.065s
I20260709 12:27:03.018290  6910 catalog_manager.cc:5697] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 1 to 2, leader changed from 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66) to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 2 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } }
I20260709 12:27:02.989704  7993 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:03.052376  7205 leader_election.cc:304] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:03.043303  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:03.070407  7091 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
W20260709 12:27:03.020648  7845 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.015s	sys 0.028s
W20260709 12:27:03.028736  7088 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.022s	sys 0.044s
W20260709 12:27:03.075021  7845 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.015s	sys 0.028s
I20260709 12:27:03.030988  7928 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:03.052376  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:03.077014  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:27:03.075206  7088 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.022s	sys 0.044s
I20260709 12:27:03.080832  7088 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 187) took 1390 ms. Trace:
W20260709 12:27:03.040005  7754 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.042s	sys 0.066s
I20260709 12:27:03.024770  8032 raft_consensus.cc:493] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:03.031291  7857 raft_consensus.cc:493] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:03.079413  7239 raft_consensus.cc:3060] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:03.040673  7990 raft_consensus.cc:493] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:03.040271  8022 raft_consensus.cc:2749] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:02.990006  8012 raft_consensus.cc:515] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:03.040022  7844 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.020s	sys 0.022s
I20260709 12:27:02.969156  7082 rpcz_store.cc:276] 0709 12:27:01.690746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.692658 (+  1912us) service_pool.cc:224] Handling call
0709 12:27:02.854323 (+1161665us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efeee 000000000036eb39 00007f287d1631e0 00007f287d22c0c4 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:02.854544 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.854820 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.854867 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.854928 (+    61us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:02.854979 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.855061 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.855219 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5797248}
I20260709 12:27:03.081281  7088 rpcz_store.cc:276] 0709 12:27:01.690047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.690156 (+   109us) service_pool.cc:224] Handling call
0709 12:27:01.920629 (+230473us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:01.920855 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.921050 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:27:02.133032 (+211982us) log.cc:844] Serialized 14 byte log entry
0709 12:27:03.080361 (+947329us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:03.080434 (+    73us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:03.080492 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.080613 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.080759 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":256778,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"spinlock_wait_cycles":3270016,"thread_start_us":1092521,"threads_started":2}
W20260709 12:27:03.045701  7936 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.009s	sys 0.029s
I20260709 12:27:03.040503  7957 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
W20260709 12:27:03.049371  6979 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.917s	user 0.032s	sys 0.079s
I20260709 12:27:03.114890  7055 leader_election.cc:400] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Vote denied by peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437) with higher term. Message: Invalid argument: T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4.
I20260709 12:27:03.018282  7156 rpcz_store.cc:276] 0709 12:27:01.404637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.407475 (+  2838us) service_pool.cc:224] Handling call
0709 12:27:01.630482 (+223007us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:02.990250 (+1359768us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10892032}
W20260709 12:27:03.124998  6982 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:03.120877  7844 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.022s	sys 0.022s
I20260709 12:27:03.085247  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:03.146391  7056 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.039s	sys 0.085s
I20260709 12:27:03.300277  7054 leader_election.cc:304] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:03.110442  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:03.100904  7788 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:03.266690  7055 leader_election.cc:403] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:03.073022  7940 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:27:03.229755  7010 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.040s	sys 0.059s
W20260709 12:27:03.275635  6979 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.135s	user 0.032s	sys 0.079s
I20260709 12:27:03.275996  7957 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:03.109277  8031 raft_consensus.cc:493] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:03.099407  8024 raft_consensus.cc:493] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:03.284713  7239 raft_consensus.cc:2468] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
W20260709 12:27:03.306917  7056 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.044s	sys 0.085s
I20260709 12:27:03.343776  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:03.286279  7161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56784 (request call id 125) took 1388 ms. Trace:
I20260709 12:27:03.117878  7857 raft_consensus.cc:515] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:03.325714  7010 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.041s	sys 0.060s
I20260709 12:27:03.110088  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:03.302008  7054 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:03.297467  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:03.303875  7203 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
W20260709 12:27:03.239480  7690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.009s	sys 0.020s
I20260709 12:27:03.305787  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
W20260709 12:27:03.327395  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 212644us
I20260709 12:27:03.416406  7055 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:03.122171  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:03.281229  7158 raft_consensus.cc:1240] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:27:03.293951  7234 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.029s	user 0.056s	sys 0.094s
W20260709 12:27:03.271157  7936 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.010s	sys 0.037s
I20260709 12:27:03.285054  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:03.029258  7762 consensus_queue.cc:260] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:03.227653  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 109173us
I20260709 12:27:03.098827  7928 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:03.069512  7739 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.241s	user 0.014s	sys 0.055s
I20260709 12:27:03.098497  7754 raft_consensus.cc:697] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:03.299619  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:03.299800  7927 raft_consensus.cc:493] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:03.354056  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:03.350157  7015 raft_consensus.cc:2468] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
W20260709 12:27:03.329629  7647 consensus_meta.cc:287] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 1.073s	user 0.012s	sys 0.000s
W20260709 12:27:03.409366  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 105613us
I20260709 12:27:03.114322  8032 raft_consensus.cc:515] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:03.336596  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:27:03.416770  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 114869us
I20260709 12:27:03.143103  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:03.322027  7885 leader_election.cc:290] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:03.417845  7128 leader_election.cc:304] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:03.266971  8033 consensus_queue.cc:1048] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.077s
W20260709 12:27:03.352777  7951 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.033s	sys 0.067s
I20260709 12:27:03.144402  7990 raft_consensus.cc:515] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:03.343535  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:03.523752  7951 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.151s	user 0.033s	sys 0.068s
I20260709 12:27:03.471916  7013 raft_consensus.cc:2468] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:27:03.328740  7238 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:03.472302  7205 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:03.341416  7230 raft_consensus.cc:2468] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
W20260709 12:27:03.437297  7690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.174s	user 0.009s	sys 0.020s
I20260709 12:27:03.401963  8028 leader_election.cc:290] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:03.075682  8020 consensus_queue.cc:260] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:03.548626  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 76426.5us
I20260709 12:27:03.484615  7091 raft_consensus.cc:1240] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:27:03.415948  8009 raft_consensus.cc:493] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:03.402995  8042 raft_consensus.cc:3060] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:27:03.469691  7234 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.204s	user 0.056s	sys 0.094s
I20260709 12:27:03.340395  7788 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:03.563743  8028 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.537312  8038 raft_consensus.cc:2804] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:03.498605  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:03.564643  8038 raft_consensus.cc:697] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:03.565122  7788 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:03.565624  8038 consensus_queue.cc:237] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:03.566279  8017 raft_consensus.cc:2804] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:03.502566  7054 leader_election.cc:304] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:03.567159  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:03.567734  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 65281.2us
I20260709 12:27:03.569808  8032 leader_election.cc:290] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:03.570358  8032 raft_consensus.cc:2804] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:03.570761  8032 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.571223  8032 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:03.571666  8045 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:03.572693  7239 raft_consensus.cc:2410] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:27:03.441567  7528 raft_consensus.cc:2804] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:03.346637  8031 raft_consensus.cc:515] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:03.582249  7129 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.033s	sys 0.035s
W20260709 12:27:03.481447  7739 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.655s	user 0.015s	sys 0.056s
I20260709 12:27:03.480989  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:03.407828  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:03.503986  7650 consensus_meta.cc:287] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 1.180s	user 0.009s	sys 0.004s
W20260709 12:27:03.482692  7086 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.281s	user 0.001s	sys 0.029s
I20260709 12:27:03.500274  7996 raft_consensus.cc:2804] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:03.543982  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:03.552867  8041 raft_consensus.cc:493] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:03.402696  7940 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:03.547942  7928 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:03.570415  7054 leader_election.cc:304] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:03.407133  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:03.569825  7016 raft_consensus.cc:2468] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:27:03.537415  7235 raft_consensus.cc:2368] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2.
I20260709 12:27:03.582546  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:03.508410  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 90706.1us
I20260709 12:27:03.524673  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:03.584829  7129 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.034s	sys 0.035s
I20260709 12:27:03.557365  7956 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:03.628320  7086 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.426s	user 0.006s	sys 0.029s
I20260709 12:27:03.586241  7739 raft_consensus.cc:697] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
W20260709 12:27:03.587361  7131 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.003s	sys 0.015s
I20260709 12:27:03.498044  7927 raft_consensus.cc:515] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:03.582655  7231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.227s	user 0.046s	sys 0.078s
W20260709 12:27:03.669149  7231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.313s	user 0.046s	sys 0.078s
I20260709 12:27:03.626822  7013 raft_consensus.cc:2468] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
W20260709 12:27:03.670364  8039 log.cc:927] Time spent T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:27:03.670935  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:03.352054  8024 raft_consensus.cc:515] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:03.538749  7762 raft_consensus.cc:3060] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:03.673696  8035 log.cc:927] Time spent T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:27:03.674325  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:27:03.644279  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 73896.5us
I20260709 12:27:03.626250  7996 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
W20260709 12:27:03.662429  7131 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.003s	sys 0.016s
I20260709 12:27:03.564509  8028 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:03.679284  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 856701us
I20260709 12:27:03.600128  7528 raft_consensus.cc:697] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:03.509299  7647 raft_consensus.cc:515] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:03.583786  7690 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.574535  8009 raft_consensus.cc:515] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:03.626574  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:03.630381  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:03.681452  7131 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:03.793012  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 111643us
I20260709 12:27:03.794068  7131 leader_election.cc:304] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
W20260709 12:27:03.706019  7159 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.024s	sys 0.068s
I20260709 12:27:03.352867  7161 rpcz_store.cc:276] 0709 12:27:01.878319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.892345 (+ 14026us) service_pool.cc:224] Handling call
0709 12:27:02.897351 (+1005006us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:02.899702 (+  2351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.978448 (+ 78746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.978484 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.978536 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:02.978568 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.118524 (+139956us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b54007eb3d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:03.121900 (+  3376us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.266543 (+144643us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205841152}
I20260709 12:27:03.670380  8031 leader_election.cc:290] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:03.692626  7162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56794 (request call id 199) took 1343 ms. Trace:
I20260709 12:27:03.693390  7739 consensus_queue.cc:237] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:03.582151  8045 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:03.639870  7993 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:03.675824  7054 leader_election.cc:304] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:03.702509  7202 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.509s	user 0.099s	sys 0.165s
I20260709 12:27:03.651854  7928 raft_consensus.cc:493] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:03.628021  7650 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:03.663255  7892 leader_election.cc:290] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:03.678989  8012 leader_election.cc:290] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:03.665884  8007 raft_consensus.cc:2749] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:03.696123  7996 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:03.692140  7990 leader_election.cc:290] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:03.860210  8033 raft_consensus.cc:493] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:03.675134  7085 raft_consensus.cc:2468] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:27:03.589419  7754 consensus_queue.cc:237] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:03.851234  7159 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.025s	sys 0.068s
I20260709 12:27:03.854924  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:27:03.851554  7007 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.009s	sys 0.106s
I20260709 12:27:03.696890  7090 raft_consensus.cc:2468] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:27:03.694715  7012 raft_consensus.cc:2468] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:27:03.857272  7088 raft_consensus.cc:2468] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
W20260709 12:27:03.871544  7202 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.678s	user 0.099s	sys 0.165s
W20260709 12:27:04.002524  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 1.8087e+06us
W20260709 12:27:03.873570  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 197798us
I20260709 12:27:03.750185  7957 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:27:03.859055  7129 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.200.68:38743 timed out after 1.850s (SENT) [suppressed 10 similar messages]
I20260709 12:27:03.871382  8049 raft_consensus.cc:2749] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:03.875610  7971 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.014s	sys 0.016s
I20260709 12:27:03.835887  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:03.905597  7239 raft_consensus.cc:2468] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:03.640913  8041 raft_consensus.cc:515] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:03.861132  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:03.813336  7690 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:03.872465  7857 leader_election.cc:290] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:03.690533  8042 raft_consensus.cc:2749] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437) with higher term. Message: Invalid argument: T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4.
I20260709 12:27:03.855223  7528 consensus_queue.cc:237] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:03.877353  7163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56794 (request call id 175) took 2468 ms. Trace:
I20260709 12:27:03.907150  7930 raft_consensus.cc:2804] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:03.917232  7165 raft_consensus.cc:1240] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 3. Current term is 4. Ops: []
W20260709 12:27:03.967335  7157 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.999s	user 0.016s	sys 0.027s
I20260709 12:27:03.910389  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:03.908480  7009 raft_consensus.cc:2393] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 1: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:03.863933  7162 rpcz_store.cc:276] 0709 12:27:02.349723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.969233 (+619510us) service_pool.cc:224] Handling call
0709 12:27:02.990984 (+ 21751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.016584 (+ 25600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:03.017286 (+   702us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:03.024263 (+  6977us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:03.029939 (+  5676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.692350 (+662411us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b54007eb8d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:03.692399 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.692539 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23567744}
I20260709 12:27:03.986521  7993 raft_consensus.cc:2804] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:03.877825  7928 raft_consensus.cc:515] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:04.019723  6980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.023s	sys 0.094s
W20260709 12:27:04.086611  6980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.023s	sys 0.094s
W20260709 12:27:04.086982  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 974461us
I20260709 12:27:04.087755  6980 leader_election.cc:304] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:04.000335  7007 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.133s	user 0.010s	sys 0.106s
W20260709 12:27:04.088508  8047 log.cc:927] Time spent T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.060s	user 0.001s	sys 0.001s
W20260709 12:27:04.054013  7971 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.081s	user 0.014s	sys 0.020s
I20260709 12:27:04.090535  7971 raft_consensus.cc:2749] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:04.022589  7885 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.941542  8012 raft_consensus.cc:2804] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:04.082659  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:04.092809  8012 raft_consensus.cc:493] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:04.093420  8012 raft_consensus.cc:3060] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:04.093585  8051 log.cc:927] Time spent T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 12:27:04.093958  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:04.094641  7085 raft_consensus.cc:2468] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:27:04.094795  7010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34210 (request call id 88) took 2044 ms. Trace:
I20260709 12:27:04.095793  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:03.945392  8033 raft_consensus.cc:515] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:04.031029  7892 raft_consensus.cc:493] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
W20260709 12:27:04.097082  8053 log.cc:927] Time spent T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:27:04.022230  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:04.074321  6981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:04.074419  7157 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.106s	user 0.017s	sys 0.028s
I20260709 12:27:04.020778  7082 raft_consensus.cc:2468] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:27:04.087893  7928 leader_election.cc:290] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:04.001770  7926 raft_consensus.cc:2749] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:04.092382  7885 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:04.055284  7845 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.010s	sys 0.011s
I20260709 12:27:04.070889  7857 raft_consensus.cc:493] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:04.073593  7940 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:04.020378  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:04.096982  7892 raft_consensus.cc:515] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:04.100247  7285 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.054s	sys 0.054s
I20260709 12:27:04.075351  7930 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:04.072570  7957 raft_consensus.cc:493] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:04.075258  8044 raft_consensus.cc:493] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:04.101594  8031 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.096426  7085 raft_consensus.cc:2468] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
W20260709 12:27:04.120669  7285 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.054s	sys 0.054s
I20260709 12:27:04.099167  7993 raft_consensus.cc:493] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:04.142964  7993 raft_consensus.cc:3060] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.102774  7156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56782 (request call id 128) took 1027 ms. Trace:
I20260709 12:27:04.144737  7156 rpcz_store.cc:276] 0709 12:27:03.071998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.852386 (+780388us) service_pool.cc:224] Handling call
0709 12:27:04.098838 (+246452us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:04.101768  7161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56782 (request call id 123) took 1059 ms. Trace:
I20260709 12:27:04.115763  7927 leader_election.cc:290] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:04.122521  7928 raft_consensus.cc:493] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:27:04.115346  7845 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.010s	sys 0.011s
I20260709 12:27:04.098035  7089 raft_consensus.cc:2468] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
W20260709 12:27:04.121119  7985 consensus_meta.cc:287] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 1.947s	user 0.006s	sys 0.010s
I20260709 12:27:04.113181  8040 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.125505  7957 raft_consensus.cc:515] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:04.112890  7082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46252 (request call id 198) took 1021 ms. Trace:
I20260709 12:27:04.111826  7647 leader_election.cc:290] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:27:04.146546  6982 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.003s	sys 0.011s
I20260709 12:27:04.126078  7930 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.145967  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:04.201059  6982 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.003s	sys 0.011s
I20260709 12:27:04.199728  7985 raft_consensus.cc:515] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:04.214883  7014 raft_consensus.cc:1240] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:04.214543  7690 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:04.216147  7985 leader_election.cc:290] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:04.216778  7157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56794 (request call id 192) took 2249 ms. Trace:
I20260709 12:27:04.199816  8045 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:04.190066  8033 leader_election.cc:290] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:04.227885  7054 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:04.196393  7158 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56782 (request call id 129) took 1116 ms. Trace:
I20260709 12:27:04.141963  8044 raft_consensus.cc:515] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:04.122582  8009 leader_election.cc:290] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:04.128017  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:04.132246  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:04.146898  7971 raft_consensus.cc:493] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.192886  7892 leader_election.cc:290] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:04.131892  7940 raft_consensus.cc:493] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:04.117654  7857 raft_consensus.cc:515] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:04.196072  7650 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:04.147626  8031 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:04.118505  7164 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.119s	user 0.009s	sys 0.047s
I20260709 12:27:04.216799  7985 raft_consensus.cc:493] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:27:04.233475  6982 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.072808  7163 rpcz_store.cc:276] 0709 12:27:01.403108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.403695 (+   587us) service_pool.cc:224] Handling call
0709 12:27:01.463167 (+ 59472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:01.911950 (+448783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:01.913447 (+  1497us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:01.986813 (+ 73366us) log.cc:844] Serialized 26 byte log entry
0709 12:27:03.028786 (+1041973us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:03.628972 (+600186us) log.cc:844] Serialized 14 byte log entry
0709 12:27:03.651962 (+ 22990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.667268 (+ 15306us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:03.851840 (+184572us) raft_consensus.cc:1685] finished
0709 12:27:03.856477 (+  4637us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.870881 (+ 14404us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41398,"prepare.queue_time_us":1040069,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":3746,"raft.queue_time_us":14001,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":10612,"thread_start_us":1354097,"threads_started":2,"wal-append.queue_time_us":1477477}
I20260709 12:27:04.196542  7928 raft_consensus.cc:515] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:04.095196  7010 rpcz_store.cc:276] 0709 12:27:02.050679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.264629 (+213950us) service_pool.cc:224] Handling call
0709 12:27:02.265021 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:02.269718 (+  4697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.272071 (+  2353us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:02.294586 (+ 22515us) log.cc:844] Serialized 26 byte log entry
0709 12:27:03.438886 (+1144300us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:03.467515 (+ 28629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.480021 (+ 12506us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:04.094564 (+614543us) raft_consensus.cc:1685] finished
0709 12:27:04.094581 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.094733 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1459,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":7477,"thread_start_us":1108688,"threads_started":1,"wal-append.queue_time_us":1542106}
I20260709 12:27:04.184690  7161 rpcz_store.cc:276] 0709 12:27:03.038414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.860776 (+822362us) service_pool.cc:224] Handling call
0709 12:27:04.098144 (+237368us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:04.201419  8040 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:04.200346  7082 rpcz_store.cc:276] 0709 12:27:03.088007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.854602 (+766595us) service_pool.cc:224] Handling call
0709 12:27:04.109295 (+254693us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:04.256435  7156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56782 (request call id 125) took 1215 ms. Trace:
I20260709 12:27:04.350010  7285 tablet_bootstrap.cc:492] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b: No bootstrap required, opened a new log
W20260709 12:27:04.403786  7131 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.031s	sys 0.036s
I20260709 12:27:04.411772  7285 ts_tablet_manager.cc:1403] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b: Time spent bootstrapping tablet: real 1.593s	user 0.076s	sys 0.059s
W20260709 12:27:04.411860  7131 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.032s	sys 0.036s
W20260709 12:27:04.255419  7055 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.001s	sys 0.018s
W20260709 12:27:04.218709  7056 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.007s	sys 0.009s
W20260709 12:27:04.231889  8032 consensus_meta.cc:287] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.009s
W20260709 12:27:04.230602  7838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.029s	sys 0.020s
W20260709 12:27:04.357776  8057 log.cc:927] Time spent T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 12:27:04.261063  7205 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.027s	sys 0.042s
W20260709 12:27:04.236966  7951 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.015s	sys 0.020s
I20260709 12:27:04.262419  8009 raft_consensus.cc:493] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:04.232010  8045 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.237480  7690 raft_consensus.cc:2804] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:27:04.254745  7015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.002s	sys 0.014s
I20260709 12:27:04.412304  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:04.217227  7157 rpcz_store.cc:276] 0709 12:27:01.967682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.537066 (+569384us) service_pool.cc:224] Handling call
0709 12:27:02.893995 (+356929us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:02.894218 (+   223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:02.967546 (+ 73328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.967595 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:02.968115 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 12:27:04.118764 (+1150649us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:27:04.120589 (+  1825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.129430 (+  8841us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:04.216383 (+ 86953us) raft_consensus.cc:1685] finished
0709 12:27:04.216418 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.216713 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72890,"raft.queue_time_us":73455,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":12578688,"thread_start_us":1136377,"threads_started":1,"wal-append.queue_time_us":1243805}
I20260709 12:27:04.453277  7163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56782 (request call id 126) took 1414 ms. Trace:
I20260709 12:27:04.453516  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:04.453711  7163 rpcz_store.cc:276] 0709 12:27:03.039267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.305624 (+1266357us) service_pool.cc:224] Handling call
0709 12:27:04.453211 (+147587us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:04.345327  7892 raft_consensus.cc:493] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:27:04.422339  7055 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.001s	sys 0.018s
W20260709 12:27:04.424099  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 630109us
I20260709 12:27:04.460175  7285 raft_consensus.cc:359] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:04.460855  7285 raft_consensus.cc:385] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:27:04.460798  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 1.04438e+06us
I20260709 12:27:04.461421  7285 raft_consensus.cc:740] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.263429  7940 raft_consensus.cc:515] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:04.424669  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 565619us
W20260709 12:27:04.357249  8061 log.cc:927] Time spent T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
W20260709 12:27:04.497424  7284 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 1.956s	user 0.063s	sys 0.074s
W20260709 12:27:04.497766  7284 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 1.957s	user 0.063s	sys 0.074s
I20260709 12:27:04.499711  8080 raft_consensus.cc:493] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:04.501673  7090 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46238 (request call id 201) took 1458 ms. Trace:
W20260709 12:27:04.502213  7131 connection.cc:256] RPC call timeout handler was delayed by -1.380606460999843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 12:27:04.502815  7131 connection.cc:256] RPC call timeout handler was delayed by -1.0638064609997855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
I20260709 12:27:04.503378  8017 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:04.503644  7131 leader_election.cc:304] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:04.504407  8076 raft_consensus.cc:493] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:04.504959  8076 raft_consensus.cc:515] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:04.455057  8009 raft_consensus.cc:515] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:04.506141  7284 tablet_bootstrap.cc:492] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:27:04.506692  7284 ts_tablet_manager.cc:1403] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 2.176s	user 0.076s	sys 0.075s
I20260709 12:27:04.507174  8076 leader_election.cc:290] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:04.456456  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:04.423225  7016 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34210 (request call id 94) took 1135 ms (client timeout 1500 ms). Trace:
W20260709 12:27:04.396277  7762 consensus_meta.cc:287] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.724s	user 0.012s	sys 0.000s
W20260709 12:27:04.431726  7205 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.027s	sys 0.042s
W20260709 12:27:04.414347  7231 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.007s	sys 0.009s
W20260709 12:27:04.228256  7237 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.228s	user 0.003s	sys 0.015s
W20260709 12:27:04.421506  7086 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.005s	sys 0.009s
W20260709 12:27:04.421442  6979 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.003s	sys 0.012s
I20260709 12:27:04.291360  7162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56782 (request call id 124) took 1252 ms. Trace:
I20260709 12:27:04.338341  8041 leader_election.cc:290] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:04.231088  7158 rpcz_store.cc:276] 0709 12:27:03.077839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.940629 (+862790us) service_pool.cc:224] Handling call
0709 12:27:04.194456 (+253827us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:04.424365  7056 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.010s	sys 0.009s
W20260709 12:27:04.264300  7788 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.027s	sys 0.025s
W20260709 12:27:04.439098  7015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.002s	sys 0.014s
W20260709 12:27:04.626868  7016 rpcz_store.cc:269] 0709 12:27:03.287487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.287780 (+   293us) service_pool.cc:224] Handling call
0709 12:27:04.423000 (+1135220us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540013bfd4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:04.423146 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369804544}
W20260709 12:27:04.632058  7231 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.008s	sys 0.009s
W20260709 12:27:04.645846  7086 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.005s	sys 0.010s
I20260709 12:27:04.438753  7159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56782 (request call id 113) took 2546 ms. Trace:
I20260709 12:27:04.442423  8045 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:04.444458  7857 leader_election.cc:290] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:04.445979  8072 raft_consensus.cc:493] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:04.428762  7838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.030s	sys 0.020s
W20260709 12:27:04.653627  7788 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.031s	sys 0.034s
I20260709 12:27:04.446780  7957 leader_election.cc:290] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:04.438493  7690 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:04.447671  7091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46248 (request call id 156) took 1404 ms. Trace:
I20260709 12:27:04.428545  8032 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:04.651919  7007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 262) took 2668 ms. Trace:
I20260709 12:27:04.651788  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:04.449169  7084 raft_consensus.cc:1240] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
W20260709 12:27:04.421104  7013 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.000s	sys 0.015s
I20260709 12:27:04.416392  7928 leader_election.cc:290] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:04.416939  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:04.418135  8031 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:04.457515  7984 leader_election.cc:290] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:04.459142  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:04.684783  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:04.664601  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:04.685451  7235 raft_consensus.cc:2468] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:04.688050  7236 raft_consensus.cc:2410] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:27:04.676823  7007 rpcz_store.cc:276] 0709 12:27:01.982471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.985844 (+  3373us) service_pool.cc:224] Handling call
0709 12:27:02.865194 (+879350us) spinlock_profiling.cc:243] Waited 9.12 ms on lock 0x7b58001b0698. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:02.865460 (+   266us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:02.866003 (+   543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.866056 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:02.866943 (+   887us) log.cc:844] Serialized 52 byte log entry
0709 12:27:04.088619 (+1221676us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:04.088661 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.088737 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:04.618382 (+529645us) raft_consensus.cc:1685] finished
0709 12:27:04.629416 (+ 11034us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.650509 (+ 21093us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":139,"spinlock_wait_cycles":20965760,"thread_start_us":1221160,"threads_started":1,"wal-append.queue_time_us":1246314}
W20260709 12:27:04.688535  7236 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 95) took 1655 ms (client timeout 1817 ms). Trace:
I20260709 12:27:04.688774  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
W20260709 12:27:04.688969  7236 rpcz_store.cc:269] 0709 12:27:03.033530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.040431 (+  6901us) service_pool.cc:224] Handling call
0709 12:27:04.663258 (+1622827us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b5800010298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efeee 000000000036eb39 00007f287d1631e0 00007f287d22c0c4 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:04.688477 (+ 25219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65442560}
I20260709 12:27:04.690658  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:04.690943  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:04.692436  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:04.460072  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:04.693388  7011 raft_consensus.cc:2468] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:04.466076  8044 leader_election.cc:290] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:04.693950  7011 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34210 (request call id 92) took 1409 ms (client timeout 1873 ms). Trace:
W20260709 12:27:04.694366  7011 rpcz_store.cc:269] 0709 12:27:03.284168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.295970 (+ 11802us) service_pool.cc:224] Handling call
0709 12:27:04.459969 (+1163999us) spinlock_profiling.cc:243] Waited 7.94 ms on lock 0x7b58001b0698. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efeee 000000000036eb39 00007f287d1631e0 00007f287d22c0c4 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:04.693888 (+233919us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18259840}
I20260709 12:27:04.466434  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:04.695497  7083 raft_consensus.cc:2468] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
W20260709 12:27:04.696053  7083 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46238 (request call id 195) took 1655 ms (client timeout 2126 ms). Trace:
I20260709 12:27:04.468183  8028 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:27:04.696441  7083 rpcz_store.cc:269] 0709 12:27:03.040175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.044981 (+  4806us) service_pool.cc:224] Handling call
0709 12:27:04.466267 (+1421286us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:04.695984 (+229717us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16387328}
I20260709 12:27:04.697273  7239 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 101) took 1579 ms. Trace:
I20260709 12:27:04.697957  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:04.420099  7885 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:04.473585  7085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46248 (request call id 157) took 1429 ms. Trace:
W20260709 12:27:04.474822  7089 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46238 (request call id 197) took 1433 ms (client timeout 1607 ms). Trace:
I20260709 12:27:04.475817  7981 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:04.478385  7055 leader_election.cc:304] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:04.480710  7883 raft_consensus.cc:493] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:04.481657  8024 leader_election.cc:290] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:04.703011  7528 raft_consensus.cc:493] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:04.483157  7014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 261) took 2505 ms. Trace:
I20260709 12:27:04.484932  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:04.485602  7009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34210 (request call id 95) took 1197 ms. Trace:
W20260709 12:27:04.487208  8050 log.cc:927] Time spent T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.488s	user 0.001s	sys 0.001s
W20260709 12:27:04.490607  7956 consensus_meta.cc:287] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.825s	user 0.004s	sys 0.007s
I20260709 12:27:04.491063  7087 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 196) took 1449 ms. Trace:
I20260709 12:27:04.503985  8017 raft_consensus.cc:3060] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:04.701017  7085 rpcz_store.cc:276] 0709 12:27:03.044013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.229078 (+1185065us) service_pool.cc:224] Handling call
0709 12:27:04.261131 (+ 32053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.310113 (+ 48982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:04.335193 (+ 25080us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:04.343483 (+  8290us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:04.346375 (+  2892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.473336 (+126961us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b54001c5cd4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:04.473387 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.473522 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65828608}
W20260709 12:27:04.414448  7203 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.000s	sys 0.016s
I20260709 12:27:04.268761  7985 raft_consensus.cc:515] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:04.501534  8012 raft_consensus.cc:515] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:04.537137  7926 raft_consensus.cc:493] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:04.593734  7930 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:04.613482  7157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56782 (request call id 131) took 1501 ms. Trace:
I20260709 12:27:04.582118  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:04.614473  7940 leader_election.cc:290] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:04.502242  7090 rpcz_store.cc:276] 0709 12:27:03.043123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.045037 (+  1914us) service_pool.cc:224] Handling call
0709 12:27:04.501453 (+1456416us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b540070dd54. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:04.501590 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620842368}
I20260709 12:27:04.594233  7993 raft_consensus.cc:515] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:04.595095  8040 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:04.421058  7156 rpcz_store.cc:276] 0709 12:27:03.039001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.145634 (+1106633us) service_pool.cc:224] Handling call
0709 12:27:04.254388 (+108754us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:04.533931  7892 raft_consensus.cc:515] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:04.616500  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 77759.5us
W20260709 12:27:04.464658  8038 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.004s	sys 0.014s
I20260709 12:27:04.543334  7650 raft_consensus.cc:2804] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:04.500303  8080 raft_consensus.cc:515] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:04.618302  7284 raft_consensus.cc:359] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:04.629354  7088 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46252 (request call id 196) took 1542 ms (client timeout 1857 ms). Trace:
I20260709 12:27:04.633296  6910 catalog_manager.cc:5697] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 1 to 2, leader changed from 022925662268440c91fff7e8732d7a0b (127.3.200.67) to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:04.646170  6913 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48270 (request call id 71) took 6550 ms. Trace:
W20260709 12:27:04.642403  7237 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.640s	user 0.004s	sys 0.016s
W20260709 12:27:04.289148  6982 leader_election.cc:343] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.652295  7015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34210 (request call id 100) took 1076 ms. Trace:
I20260709 12:27:04.260370  7971 raft_consensus.cc:515] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:04.649459  6979 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.004s	sys 0.012s
I20260709 12:27:04.446478  7670 consensus_queue.cc:1059] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:04.649564  8009 leader_election.cc:290] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:04.668666  8072 raft_consensus.cc:515] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:04.669260  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:04.677350  7013 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.000s	sys 0.016s
I20260709 12:27:04.681691  7233 raft_consensus.cc:2468] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:04.684065  8032 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:04.260790  7164 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.262s	user 0.011s	sys 0.048s
I20260709 12:27:04.649261  7162 rpcz_store.cc:276] 0709 12:27:03.038710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.111290 (+1072580us) service_pool.cc:224] Handling call
0709 12:27:04.289239 (+177949us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:04.679979  8022 raft_consensus.cc:2749] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:04.463963  7285 consensus_queue.cc:260] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:04.467074  7996 consensus_meta.cc:287] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.505s	user 0.013s	sys 0.000s
W20260709 12:27:04.436338  7951 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.016s	sys 0.022s
W20260709 12:27:04.698845  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 82605.9us
I20260709 12:27:04.696111  7165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56784 (request call id 134) took 2256 ms. Trace:
I20260709 12:27:04.665831  8082 raft_consensus.cc:493] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:04.674892  7091 rpcz_store.cc:276] 0709 12:27:03.043748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.111132 (+ 67384us) service_pool.cc:224] Handling call
0709 12:27:03.111583 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:03.552091 (+440508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.447408 (+895317us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54005046d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:04.447608 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":856917760}
I20260709 12:27:04.697825  7239 rpcz_store.cc:276] 0709 12:27:03.118188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.582254 (+464066us) service_pool.cc:224] Handling call
0709 12:27:04.697055 (+1114801us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b5400700154. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:04.697197 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611271040}
I20260709 12:27:04.692245  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:04.704936  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 226662us
I20260709 12:27:04.678184  7690 raft_consensus.cc:3060] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:04.421379  7128 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.009s	sys 0.006s
I20260709 12:27:04.707584  7205 leader_election.cc:304] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:04.703794  7528 raft_consensus.cc:515] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:04.895485  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:04.897078  8052 raft_consensus.cc:2804] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:04.896413  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:04.897576  8052 raft_consensus.cc:493] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:04.898236  7233 raft_consensus.cc:2410] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:04.897852  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:04.899151  8012 leader_election.cc:290] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:27:04.898870  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 191363us
I20260709 12:27:04.899703  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:04.901022  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:04.901681  7128 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.249s	user 0.012s	sys 0.008s
W20260709 12:27:04.903118  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 1.25017e+06us
I20260709 12:27:04.904271  7996 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:04.906682  7996 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:04.898015  8052 raft_consensus.cc:3060] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.906741  7919 raft_consensus.cc:3055] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:04.908727  7919 raft_consensus.cc:740] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:04.909193  7285 ts_tablet_manager.cc:1434] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b: Time spent starting tablet: real 0.497s	user 0.006s	sys 0.003s
I20260709 12:27:04.909746  7919 consensus_queue.cc:260] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:04.910032  7088 rpcz_store.cc:269] 0709 12:27:03.087379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.240537 (+153158us) service_pool.cc:224] Handling call
0709 12:27:04.629157 (+1388620us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54002030d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:04.629270 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":816130432}
I20260709 12:27:04.911156  7919 raft_consensus.cc:3060] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:04.911293  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:04.913028  7129 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:04.708019  7084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 199) took 1664 ms. Trace:
I20260709 12:27:04.801239  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:04.914427  6910 catalog_manager.cc:5697] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 1 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:04.918871  7284 raft_consensus.cc:385] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:04.788026  7230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 102) took 1490 ms. Trace:
I20260709 12:27:04.919509  7284 raft_consensus.cc:740] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.710831  7956 raft_consensus.cc:2749] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:04.717103  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:04.922657  7238 raft_consensus.cc:1240] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:04.922855  7157 rpcz_store.cc:276] 0709 12:27:03.112085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.456124 (+1344039us) service_pool.cc:224] Handling call
0709 12:27:04.613411 (+157287us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:04.921985  8038 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.293s	user 0.022s	sys 0.019s
I20260709 12:27:04.709879  7087 rpcz_store.cc:276] 0709 12:27:03.041304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.045148 (+  3844us) service_pool.cc:224] Handling call
0709 12:27:04.489868 (+1444720us) spinlock_profiling.cc:243] Waited 6.17 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:04.490168 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.490713 (+   545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.490971 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14199680}
I20260709 12:27:04.916874  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:04.925539  7845 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:04.916886  8007 raft_consensus.cc:2804] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:04.925774  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:04.926630  8007 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:04.927629  7082 raft_consensus.cc:2468] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:27:04.924000  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:04.927627  8007 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:04.929543  7158 raft_consensus.cc:2468] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:04.896598  7926 raft_consensus.cc:515] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:04.936798  7926 leader_election.cc:290] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:04.928185  7055 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:04.920308  7230 rpcz_store.cc:276] 0709 12:27:03.230183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.583688 (+353505us) service_pool.cc:224] Handling call
0709 12:27:04.453181 (+869493us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b5800010298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:04.453396 (+   215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:04.453762 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:04.453794 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:04.454281 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 12:27:04.668501 (+214220us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:04.674222 (+  5721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.680177 (+  5955us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:04.687546 (+  7369us) raft_consensus.cc:1685] finished
0709 12:27:04.699970 (+ 12424us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.720105 (+ 20135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18115,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"spinlock_wait_cycles":7813376,"thread_start_us":177522,"threads_started":1,"wal-append.queue_time_us":212420}
I20260709 12:27:04.937561  8082 raft_consensus.cc:515] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:04.940284  7128 connection.cc:256] RPC call timeout handler was delayed by -1.0501169169997411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 12:27:04.921193  7284 consensus_queue.cc:260] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:04.900130  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:04.925191  7013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34210 (request call id 101) took 1348 ms. Trace:
I20260709 12:27:04.926446  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:04.917447  6982 leader_election.cc:304] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:04.662633  7159 rpcz_store.cc:276] 0709 12:27:01.892680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.895628 (+  2948us) service_pool.cc:224] Handling call
0709 12:27:02.863639 (+968011us) spinlock_profiling.cc:243] Waited 9.07 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:02.863922 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.864204 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:27:03.968981 (+1104777us) log.cc:844] Serialized 14 byte log entry
0709 12:27:04.402225 (+433244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:04.407900 (+  5675us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:04.420381 (+ 12481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.425479 (+  5098us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.435679 (+ 10200us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1197554,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3311,"raft.queue_time_us":3694,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6761,"spinlock_wait_cycles":20859776,"thread_start_us":1442465,"threads_started":2,"wal-append.queue_time_us":468237}
I20260709 12:27:04.924428  7015 rpcz_store.cc:276] 0709 12:27:03.576338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.585649 (+  9311us) service_pool.cc:224] Handling call
0709 12:27:03.631154 (+ 45505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.651941 (+1020787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:04.651969 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:04.652011 (+    42us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:27:04.652039 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.652107 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.652245 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":228491,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"thread_start_us":1020358,"threads_started":1}
I20260709 12:27:05.002241  7284 ts_tablet_manager.cc:1434] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.495s	user 0.013s	sys 0.005s
W20260709 12:27:05.002465  7203 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.383s	user 0.015s	sys 0.028s
I20260709 12:27:04.916983  7165 rpcz_store.cc:276] 0709 12:27:02.439706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.013044 (+573338us) service_pool.cc:224] Handling call
0709 12:27:03.013670 (+   626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.072108 (+1058438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.695797 (+623689us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b54007eaed4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:04.696032 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077274880}
I20260709 12:27:04.895485  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:04.929183  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:04.934365  7161 raft_consensus.cc:2410] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:27:05.002202  7164 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56784 (request call id 133) took 2585 ms. Trace:
I20260709 12:27:04.926218  7845 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:04.923988  7238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49174 (request call id 191) took 1367 ms. Trace:
I20260709 12:27:04.913976  7084 rpcz_store.cc:276] 0709 12:27:03.042267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.045438 (+  3171us) service_pool.cc:224] Handling call
0709 12:27:04.448712 (+1403274us) spinlock_profiling.cc:243] Waited 6.79 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:04.448946 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.679500 (+230554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.706465 (+ 26965us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15613312}
I20260709 12:27:04.803090  8045 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:27:04.796281  8089 log.cc:927] Time spent T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:27:04.955313  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
W20260709 12:27:04.788483  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 49266.9us
I20260709 12:27:04.716701  8068 raft_consensus.cc:2749] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:04.702095  7089 rpcz_store.cc:269] 0709 12:27:03.041613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.045172 (+  3559us) service_pool.cc:224] Handling call
0709 12:27:04.474639 (+1429467us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54006d29d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:04.474755 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1322778368}
I20260709 12:27:04.702219  7086 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 191) took 3010 ms. Trace:
I20260709 12:27:04.963409  7055 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:04.795411  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:05.046811  7985 leader_election.cc:290] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:27:05.047266  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 83954.9us
I20260709 12:27:05.047828  8012 raft_consensus.cc:2804] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:05.048221  8012 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:05.048525  8012 raft_consensus.cc:3060] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.048842  7055 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:05.050132  7055 leader_election.cc:343] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:05.050280  7161 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56782 (request call id 132) took 1933 ms (client timeout 2231 ms). Trace:
W20260709 12:27:05.050737  7161 rpcz_store.cc:269] 0709 12:27:03.117195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.416628 (+1299433us) service_pool.cc:224] Handling call
0709 12:27:05.050060 (+633432us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b54005c2954. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:05.050223 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":566640000}
I20260709 12:27:05.000609  7013 rpcz_store.cc:276] 0709 12:27:03.576752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.671922 (+ 95170us) service_pool.cc:224] Handling call
0709 12:27:03.672201 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.924802 (+1252601us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:27:04.924838 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:04.924889 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:04.924925 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.925007 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.925139 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6108,"raft.queue_time_us":187880,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"thread_start_us":1246047,"threads_started":1}
I20260709 12:27:05.050972  7055 leader_election.cc:304] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:05.001302  7993 leader_election.cc:290] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:04.917676  7971 leader_election.cc:290] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:05.012378  6980 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:04.796707  7234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49160 (request call id 157) took 3152 ms. Trace:
I20260709 12:27:04.799968  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:04.924095  6913 rpcz_store.cc:276] 0709 12:26:58.082655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.083399 (+   744us) service_pool.cc:224] Handling call
0709 12:27:04.632644 (+6549245us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:58.808916 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:58.811241 (+  2325us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:58.811296 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:26:58.811321 (+    25us) tablet.cc:662] Decoding operations
0709 12:26:58.812111 (+   790us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:58.812192 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:58.812221 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:26:58.812952 (+   731us) tablet.cc:701] Row locks acquired
0709 12:26:58.812990 (+    38us) write_op.cc:260] PREPARE: finished
0709 12:26:58.813190 (+   200us) write_op.cc:270] Start()
0709 12:26:58.832767 (+ 19577us) write_op.cc:276] Timestamp: P: 1783600018813125 usec, L: 0
0709 12:26:58.848858 (+ 16091us) op_driver.cc:348] REPLICATION: starting
0709 12:26:59.125563 (+276705us) log.cc:844] Serialized 2078 byte log entry
0709 12:26:59.308602 (+183039us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b4400022b4c. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f287504dc85 00007f287504e6a2 00007f2877dc01db 00007f2877dbbaaf 00007f287510a0ac 00007f287df649a9 00007f287512669b 00007f287512493f 00007f2875126c02 00007f2877dae20b
0709 12:26:59.937821 (+629219us) op_driver.cc:464] REPLICATION: finished
0709 12:27:00.163644 (+225823us) write_op.cc:301] APPLY: starting
0709 12:27:00.163736 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:00.163915 (+   179us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:00.163953 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:00.179218 (+ 15265us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:00.244777 (+ 65559us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:27:00.269410 (+ 24633us) write_op.cc:312] APPLY: finished
0709 12:27:00.274321 (+  4911us) log.cc:844] Serialized 46 byte log entry
0709 12:27:00.275369 (+  1048us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:00.275517 (+   148us) write_op.cc:454] Released schema lock
0709 12:27:00.275601 (+    84us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:00.276113 (+   512us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:00.276159 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4855,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":195315,"apply.run_cpu_time_us":3247,"apply.run_wall_time_us":112380,"num_ops":5,"prepare.queue_time_us":98231,"prepare.run_cpu_time_us":65183,"prepare.run_wall_time_us":741225,"raft.queue_time_us":125567,"raft.run_cpu_time_us":11910,"raft.run_wall_time_us":265748,"replication_time_us":1027801,"spinlock_wait_cycles":63083904,"thread_start_us":627099,"threads_started":4,"wal-append.queue_time_us":593642,"wal-append.run_cpu_time_us":10548,"wal-append.run_wall_time_us":1567960}]]}
I20260709 12:27:05.056159  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.056408  7237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49160 (request call id 156) took 3463 ms. Trace:
I20260709 12:27:05.056751  8082 leader_election.cc:290] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:27:05.014016  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 724886us
I20260709 12:27:04.799360  7231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 88) took 2578 ms. Trace:
I20260709 12:27:04.951843  7230 raft_consensus.cc:1275] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:27:04.927618  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:04.804306  8020 raft_consensus.cc:3060] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:04.710803  8071 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:04.921382  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:04.918017  7528 leader_election.cc:290] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:04.945726  7129 leader_election.cc:304] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:05.071048  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 125442us
I20260709 12:27:04.953787  8038 raft_consensus.cc:493] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.027518  7284 tablet_bootstrap.cc:492] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca: Bootstrap starting.
I20260709 12:27:04.797789  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:05.039021  7131 leader_election.cc:304] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:05.075009  7131 leader_election.cc:304] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:04.896306  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:05.001576  8032 raft_consensus.cc:2749] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.024825  8031 raft_consensus.cc:2749] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:04.798688  7012 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34210 (request call id 91) took 1514 ms (client timeout 1629 ms). Trace:
I20260709 12:27:04.956192  7940 raft_consensus.cc:493] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:05.042220  7930 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:04.998539  7903 raft_consensus.cc:493] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.043171  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:05.083649  7165 raft_consensus.cc:2468] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:27:05.043980  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:05.042762  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:05.027212  8094 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:05.045349  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.708238  7883 raft_consensus.cc:515] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:05.080077  7163 raft_consensus.cc:2468] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:05.093395  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:05.093719  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:05.094565  7163 raft_consensus.cc:2393] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 4: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:05.094856  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:05.095613  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:04.950304  7788 raft_consensus.cc:493] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
W20260709 12:27:04.923374  7160 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56782 (request call id 122) took 1885 ms (client timeout 1629 ms). Trace:
I20260709 12:27:05.053445  7088 raft_consensus.cc:2468] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:05.101828  7088 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46248 (request call id 159) took 2057 ms. Trace:
I20260709 12:27:04.896380  7085 raft_consensus.cc:2468] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
W20260709 12:27:05.104374  7160 rpcz_store.cc:269] 0709 12:27:03.037994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.040520 (+  2526us) service_pool.cc:224] Handling call
0709 12:27:04.709983 (+1669463us) spinlock_profiling.cc:243] Waited 6.77 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efeee 000000000036eb39 00007f287d1631e0 00007f287d22c0c4 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:04.923306 (+213323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15560448}
I20260709 12:27:05.083232  7903 raft_consensus.cc:515] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:05.106092  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:05.106899  7160 raft_consensus.cc:3060] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:05.107857  7903 leader_election.cc:290] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:05.102156  7083 raft_consensus.cc:2468] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:27:04.706395  8036 raft_consensus.cc:2749] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:05.012365  7650 raft_consensus.cc:493] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
W20260709 12:27:05.057838  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 45538.5us
I20260709 12:27:05.057888  6982 leader_election.cc:304] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:05.015659  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:05.119472  7091 raft_consensus.cc:2468] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:27:05.057063  7013 raft_consensus.cc:2410] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:05.061540  7055 leader_election.cc:304] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:05.025672  7082 raft_consensus.cc:2468] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:27:05.078985  7943 consensus_queue.cc:1048] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:27:05.075872  8038 raft_consensus.cc:515] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:04.703826  7014 rpcz_store.cc:276] 0709 12:27:01.977331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.980862 (+  3531us) service_pool.cc:224] Handling call
0709 12:27:02.877348 (+896486us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b58001b0698. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efeee 000000000036eb39 00007f287d1631e0 00007f287d22c0c4 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:02.877537 (+   189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.215432 (+1337895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.482781 (+267349us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54003ee9d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:04.483049 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3087684096}
I20260709 12:27:05.054466  7007 raft_consensus.cc:3060] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:04.918599  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:05.054589  7673 raft_consensus.cc:493] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:05.039839  8080 leader_election.cc:290] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:04.707799  7009 rpcz_store.cc:276] 0709 12:27:03.288163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.293601 (+  5438us) service_pool.cc:224] Handling call
0709 12:27:04.485385 (+1191784us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b540079e0d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:04.485536 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":971368704}
I20260709 12:27:05.119383  7650 raft_consensus.cc:3060] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.057389  8072 leader_election.cc:290] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:05.129566  8022 raft_consensus.cc:2749] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:05.021414  7238 rpcz_store.cc:276] 0709 12:27:03.589636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.800441 (+1210805us) service_pool.cc:224] Handling call
0709 12:27:04.800895 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.923157 (+122262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.923754 (+   597us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54003fc854. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:04.923924 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279418624}
I20260709 12:27:05.070843  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:05.136502  7157 raft_consensus.cc:2468] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:27:05.137579  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:05.139039  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:05.139807  7157 raft_consensus.cc:2468] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:27:05.074857  7090 raft_consensus.cc:3060] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:27:05.140326  7673 raft_consensus.cc:515] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:05.065713  8009 raft_consensus.cc:2749] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:05.098062  8094 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:05.086267  7926 consensus_queue.cc:1059] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:27:05.076848  8076 raft_consensus.cc:3060] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:05.091675  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.094429  7883 leader_election.cc:290] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:04.967962  6910 catalog_manager.cc:5697] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 1 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:05.096328  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:05.102170  7088 rpcz_store.cc:276] 0709 12:27:03.044570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.101225 (+2056655us) service_pool.cc:224] Handling call
0709 12:27:05.101472 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.101614 (+   142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.101630 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.101660 (+    30us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:05.101680 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.101716 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.101787 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:05.071029  8071 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:05.118752  7788 raft_consensus.cc:515] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:05.121258  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 63449.8us
W20260709 12:27:05.081084  7012 rpcz_store.cc:269] 0709 12:27:03.283822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.295883 (+ 12061us) service_pool.cc:224] Handling call
0709 12:27:04.798510 (+1502627us) spinlock_profiling.cc:243] Waited 77.4 ms on lock 0x7b5400595bd4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:04.798628 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177924480}
I20260709 12:27:05.051934  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:05.098856  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:05.070508  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:05.135023  7981 consensus_queue.cc:1048] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:05.075310  8084 raft_consensus.cc:2804] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:05.075500  7885 raft_consensus.cc:2749] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:05.096922  7156 raft_consensus.cc:2468] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:27:05.096480  7163 raft_consensus.cc:2468] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:27:05.086963  7940 raft_consensus.cc:515] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:05.159358  6910 catalog_manager.cc:5697] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 1 to 2, leader changed from 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65) to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:05.162279  6982 leader_election.cc:304] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
W20260709 12:27:05.216015  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 53827.4us
W20260709 12:27:05.121258  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 59833.8us
I20260709 12:27:05.162894  7203 leader_election.cc:304] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:05.128504  8032 raft_consensus.cc:2749] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:05.171818  7131 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:05.220494  7055 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:05.132881  7971 raft_consensus.cc:2804] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:05.010318  7164 rpcz_store.cc:276] 0709 12:27:02.417338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.998308 (+580970us) service_pool.cc:224] Handling call
0709 12:27:02.998596 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.998841 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:27:04.915973 (+1917132us) log.cc:844] Serialized 14 byte log entry
0709 12:27:05.001850 (+ 85877us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.001906 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:05.001947 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.002025 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.002149 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":303,"prepare.queue_time_us":1075519,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":8404,"thread_start_us":2002241,"threads_started":2}
I20260709 12:27:05.221666  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:05.156014  8072 raft_consensus.cc:493] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.131974  8044 consensus_queue.cc:1048] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.051s
I20260709 12:27:05.192364  6980 leader_election.cc:304] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:05.217260  6982 leader_election.cc:304] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:05.129037  8031 raft_consensus.cc:2804] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:27:05.222697  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 59883.5us
W20260709 12:27:05.222918  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 51225us
I20260709 12:27:05.162021  8052 raft_consensus.cc:515] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:05.186283  7892 leader_election.cc:290] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:05.187562  8084 raft_consensus.cc:493] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:05.186441  7161 raft_consensus.cc:2468] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:05.237965  8072 raft_consensus.cc:515] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:05.246121  8084 raft_consensus.cc:3060] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.192019  7087 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46248 (request call id 158) took 2147 ms. Trace:
I20260709 12:27:05.187534  7089 raft_consensus.cc:2468] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:27:05.246846  7084 raft_consensus.cc:2393] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 1: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:05.270546  7089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46248 (request call id 167) took 1038 ms. Trace:
I20260709 12:27:05.281667  7089 rpcz_store.cc:276] 0709 12:27:04.231917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.071336 (+839419us) service_pool.cc:224] Handling call
0709 12:27:05.270479 (+199143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:05.283236  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:05.225449  7885 raft_consensus.cc:2749] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:05.220975  8082 raft_consensus.cc:2804] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:05.247303  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.276172  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.298045  7013 raft_consensus.cc:2468] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:05.056918  7237 rpcz_store.cc:276] 0709 12:27:01.592616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.597059 (+  4443us) service_pool.cc:224] Handling call
0709 12:27:02.816237 (+1219178us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b5800010298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efeee 000000000036eb39 00007f287d1631e0 00007f287d22c0c4 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:02.816403 (+   166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.937977 (+121574us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:27:04.907639 (+1969662us) log.cc:844] Serialized 14 byte log entry
0709 12:27:05.021127 (+113488us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.026762 (+  5635us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:05.041162 (+ 14400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.054218 (+ 13056us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.056354 (+  2136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6143,"prepare.queue_time_us":1445865,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":24711,"spinlock_wait_cycles":68123392,"thread_start_us":2009569,"threads_started":2,"wal-append.queue_time_us":88485}
I20260709 12:27:05.290159  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:05.244954  7670 raft_consensus.cc:2804] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:05.216061  7984 consensus_queue.cc:1059] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:27:05.271198  7892 raft_consensus.cc:2804] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:05.216226  7739 raft_consensus.cc:493] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:05.270651  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:05.239748  8031 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:05.242563  8009 raft_consensus.cc:2804] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:05.285343  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:05.307363  7089 raft_consensus.cc:2368] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for earlier term 3. Current term is 4.
I20260709 12:27:05.297693  8082 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:05.296139  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.307206  7084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46248 (request call id 168) took 1074 ms. Trace:
W20260709 12:27:05.329787  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 243821us
I20260709 12:27:05.307034  7670 raft_consensus.cc:493] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.305500  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:05.311287  7985 raft_consensus.cc:2804] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:05.305550  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:05.319936  7892 raft_consensus.cc:493] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:27:05.343421  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 151117us
I20260709 12:27:05.345467  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.347630  6980 leader_election.cc:304] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:05.348032  7016 raft_consensus.cc:2393] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 2: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:05.327863  7984 raft_consensus.cc:493] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:05.350358  6980 leader_election.cc:304] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:05.060359  7234 rpcz_store.cc:276] 0709 12:27:01.644443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.015927 (+371484us) service_pool.cc:224] Handling call
0709 12:27:02.107272 (+ 91345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:02.246462 (+139190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.248118 (+  1656us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:02.264815 (+ 16697us) log.cc:844] Serialized 26 byte log entry
0709 12:27:03.563137 (+1298322us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:03.563184 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.563272 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:04.486657 (+923385us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b4400022b4c. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f287504dc85 00007f287504e6a2 00007f2877dc01db 00007f2877dbbaaf 00007f2877daf86e 00007f2877daebb6 00007f2877dae7d8 00007f2877db8221 00007f2877db81d9 00007f2877db8169
0709 12:27:04.796320 (+309663us) raft_consensus.cc:1685] finished
0709 12:27:04.796344 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.796617 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5621,"raft.queue_time_us":66829,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":105,"spinlock_wait_cycles":5137792,"thread_start_us":1403504,"threads_started":2,"wal-append.queue_time_us":1602961}
I20260709 12:27:05.334338  8082 raft_consensus.cc:3060] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.328663  8031 raft_consensus.cc:3060] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.329911  8009 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:05.337658  7883 raft_consensus.cc:493] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.342422  7670 raft_consensus.cc:3060] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.338680  7084 rpcz_store.cc:276] 0709 12:27:04.232954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.058415 (+825461us) service_pool.cc:224] Handling call
0709 12:27:05.304622 (+246207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:05.344569  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
W20260709 12:27:05.351698  8017 consensus_meta.cc:287] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.000s
I20260709 12:27:05.059865  7231 rpcz_store.cc:276] 0709 12:27:02.209337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.214581 (+  5244us) service_pool.cc:224] Handling call
0709 12:27:02.249828 (+ 35247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:02.289079 (+ 39251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.295376 (+  6297us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:02.349905 (+ 54529us) log.cc:844] Serialized 26 byte log entry
0709 12:27:03.669600 (+1319695us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:04.667814 (+998214us) log.cc:844] Serialized 14 byte log entry
0709 12:27:04.700985 (+ 33171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.705425 (+  4440us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:04.706970 (+  1545us) raft_consensus.cc:1685] finished
0709 12:27:04.708638 (+  1668us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.717055 (+  8417us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17427,"prepare.queue_time_us":749639,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":39132,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":7601,"thread_start_us":2297414,"threads_started":2,"wal-append.queue_time_us":1678711}
I20260709 12:27:05.327509  7739 raft_consensus.cc:515] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:05.046829  7086 rpcz_store.cc:276] 0709 12:27:01.691485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.693629 (+  2144us) service_pool.cc:224] Handling call
0709 12:27:02.199547 (+505918us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:02.199750 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.199966 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:27:03.704382 (+1504416us) log.cc:844] Serialized 14 byte log entry
0709 12:27:04.666471 (+962089us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:04.668010 (+  1539us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:04.675574 (+  7564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.679894 (+  4320us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.701063 (+ 21169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1524,"prepare.queue_time_us":28103,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":3126,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":11825,"spinlock_wait_cycles":38646528,"thread_start_us":2244759,"threads_started":2,"wal-append.queue_time_us":685515}
I20260709 12:27:05.349040  7892 raft_consensus.cc:3060] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.346503  7985 raft_consensus.cc:493] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
W20260709 12:27:05.364869  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 147651us
I20260709 12:27:05.347550  7940 leader_election.cc:290] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:05.366014  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:05.274492  7087 rpcz_store.cc:276] 0709 12:27:03.044275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.088027 (+2043752us) service_pool.cc:224] Handling call
0709 12:27:05.113510 (+ 25483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.133352 (+ 19842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.151792 (+ 18440us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.155092 (+  3300us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:05.168722 (+ 13630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.181341 (+ 12619us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.188617 (+  7276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:05.353519  8044 raft_consensus.cc:2749] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:05.408140  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.370318  7016 raft_consensus.cc:1240] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:05.350147  7230 raft_consensus.cc:2468] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:27:05.387971  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.393888  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.413582  7015 raft_consensus.cc:2468] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:05.413798  7163 raft_consensus.cc:1275] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:27:05.414470  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.358448  8009 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.400990  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.415161  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:05.415601  7008 raft_consensus.cc:2468] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:27:05.415863  7086 raft_consensus.cc:2468] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:27:05.416595  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.416878  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:05.417500  7008 raft_consensus.cc:2410] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:05.401397  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.418090  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:05.401523  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:05.419147  7084 raft_consensus.cc:2393] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 1: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:05.420053  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:05.420686  7084 raft_consensus.cc:2468] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:05.415197  7015 raft_consensus.cc:2393] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 1: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:05.421561  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:05.402300  8107 raft_consensus.cc:2804] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:05.422775  8107 raft_consensus.cc:493] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:05.423166  8107 raft_consensus.cc:3060] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.423852  8076 raft_consensus.cc:2749] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:05.367002  8017 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:05.423878  8009 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:05.429186  8052 leader_election.cc:290] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:05.429373  8017 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:05.382141  7157 raft_consensus.cc:1275] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:27:05.429847  8009 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:05.408151  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:05.430892  7234 raft_consensus.cc:3060] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:05.430928  7090 raft_consensus.cc:2468] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:05.431888  7164 raft_consensus.cc:2468] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:27:05.432127  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:05.398483  7985 raft_consensus.cc:3060] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.355089  7788 leader_election.cc:290] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:05.410229  7091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46248 (request call id 160) took 2322 ms. Trace:
W20260709 12:27:05.424108  7919 consensus_meta.cc:287] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
I20260709 12:27:05.366420  8094 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:05.411652  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.394853  8071 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:05.401939  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:27:05.404242  7690 consensus_meta.cc:287] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.000s
I20260709 12:27:05.371413  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:05.404836  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:05.434690  8012 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:05.435221  8072 leader_election.cc:290] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:05.424957  8038 leader_election.cc:290] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:05.435858  7990 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.436443  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:05.357645  7883 raft_consensus.cc:515] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:05.358227  7984 raft_consensus.cc:515] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:05.441442  7160 raft_consensus.cc:2468] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:27:05.442310  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:05.454959  7091 rpcz_store.cc:276] 0709 12:27:03.088055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.120389 (+2032334us) service_pool.cc:224] Handling call
0709 12:27:05.123775 (+  3386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:05.124940 (+  1165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.124990 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:05.134770 (+  9780us) log.cc:844] Serialized 26 byte log entry
0709 12:27:05.299719 (+164949us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:05.299790 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.299880 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:05.410030 (+110150us) raft_consensus.cc:1685] finished
0709 12:27:05.410051 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.410177 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":592,"raft.queue_time_us":745,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":123,"thread_start_us":163381,"threads_started":1,"wal-append.queue_time_us":215053}
I20260709 12:27:05.383072  7237 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:05.500982  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 43592.3us
I20260709 12:27:05.379915  8031 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:05.411773  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:05.458994  7239 raft_consensus.cc:2468] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:05.449491  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:05.412719  7007 raft_consensus.cc:2468] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:05.513950  7670 raft_consensus.cc:515] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:05.424633  7010 raft_consensus.cc:2468] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:27:05.507154  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:05.515384  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:05.515702  7236 raft_consensus.cc:2468] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:27:05.515826  7084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 202) took 2402 ms. Trace:
I20260709 12:27:05.510082  7984 leader_election.cc:290] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:05.511883  7883 leader_election.cc:290] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:05.516434  7084 rpcz_store.cc:276] 0709 12:27:03.113497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.472467 (+2358970us) service_pool.cc:224] Handling call
0709 12:27:05.515136 (+ 42669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.515374 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.515424 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.515482 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:05.515532 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.515608 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.515751 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:05.523676  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 127147us
I20260709 12:27:05.525230  6982 leader_election.cc:304] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:05.486627  7990 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:05.474534  7159 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.520490  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:05.474769  7087 raft_consensus.cc:2468] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 0.
I20260709 12:27:05.533684  7128 leader_election.cc:304] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:05.535161  7128 leader_election.cc:304] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:05.538473  7128 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:05.504187  8072 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:05.529111  7160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56784 (request call id 141) took 1039 ms. Trace:
I20260709 12:27:05.523378  7670 leader_election.cc:290] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:05.473392  7690 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:05.526054  7162 raft_consensus.cc:2468] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:27:05.526871  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:05.552990  8110 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:05.555148  7284 tablet_bootstrap.cc:654] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:05.559171  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.559959  7739 leader_election.cc:290] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:05.568032  7236 raft_consensus.cc:1275] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:27:05.592310  7236 pending_rounds.cc:85] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41: Aborting all ops after (but not including) 1
I20260709 12:27:05.592612  7236 pending_rounds.cc:107] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:27:05.592872  7236 raft_consensus.cc:2889] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:05.568682  8076 raft_consensus.cc:2749] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:05.571695  8007 consensus_meta.cc:287] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.001s
I20260709 12:27:05.527369  8058 consensus_queue.cc:1048] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:27:05.531519  7788 raft_consensus.cc:2804] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:05.550338  7128 leader_election.cc:304] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:05.552318  8106 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:05.542897  8038 raft_consensus.cc:2804] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:05.538422  7084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 208) took 1065 ms. Trace:
I20260709 12:27:05.603199  8106 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:05.599781  7788 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:05.604188  7788 raft_consensus.cc:3060] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.584086  8110 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:05.584738  8012 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:05.575222  8072 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:05.617904  7690 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:05.618302  8072 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:05.619330  7981 raft_consensus.cc:3055] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:05.619553  7087 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 210) took 1149 ms. Trace:
I20260709 12:27:05.619776  7981 raft_consensus.cc:740] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:05.586408  7845 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:05.620913  7892 raft_consensus.cc:515] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:05.623171  7236 raft_consensus.cc:1240] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:27:05.588524  7088 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 201) took 2479 ms. Trace:
I20260709 12:27:05.589607  8031 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:05.584745  7083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46248 (request call id 169) took 1333 ms. Trace:
I20260709 12:27:05.546061  7012 raft_consensus.cc:1240] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:05.623564  7650 raft_consensus.cc:515] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:05.592988  7090 raft_consensus.cc:1240] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:05.637665  7892 leader_election.cc:290] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:05.639739  7090 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 209) took 1169 ms. Trace:
I20260709 12:27:05.545696  8111 consensus_queue.cc:1059] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:27:05.573710  7086 raft_consensus.cc:3060] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.576231  7082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 200) took 2460 ms. Trace:
W20260709 12:27:05.600200  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 49959.5us
W20260709 12:27:05.601482  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 64289.7us
I20260709 12:27:05.551298  7160 rpcz_store.cc:276] 0709 12:27:04.486267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.105727 (+619460us) service_pool.cc:224] Handling call
0709 12:27:05.525139 (+419412us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:05.603139  7084 rpcz_store.cc:276] 0709 12:27:04.469599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.517908 (+1048309us) service_pool.cc:224] Handling call
0709 12:27:05.518284 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.518517 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.518558 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.518619 (+    61us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:05.518667 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.523524 (+  4857us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.534678 (+ 11154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:05.580683  8094 raft_consensus.cc:2804] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:05.611006  8038 raft_consensus.cc:493] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:05.602697  8076 raft_consensus.cc:2804] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:05.625005  7088 rpcz_store.cc:276] 0709 12:27:03.109594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.156493 (+2046899us) service_pool.cc:224] Handling call
0709 12:27:05.586819 (+430326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.587004 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.587031 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.587074 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:05.587105 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.587171 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.588340 (+  1169us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54005ab750. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782138ad 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:05.588455 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":926376704}
I20260709 12:27:05.600287  8007 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:05.579984  8082 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:05.660656  7055 leader_election.cc:400] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Vote denied by peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743) with higher term. Message: Invalid argument: T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2.
W20260709 12:27:05.662359  8115 log.cc:927] Time spent T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:27:05.619993  7087 rpcz_store.cc:276] 0709 12:27:04.470110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.579610 (+1109500us) service_pool.cc:224] Handling call
0709 12:27:05.599458 (+ 19848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.619157 (+ 19699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.619197 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.619258 (+    61us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:05.619296 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.619364 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.619492 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:05.695019  7055 leader_election.cc:403] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:05.695802  8106 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:05.696920  7015 raft_consensus.cc:1240] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:05.698685  8007 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:05.638959  7083 rpcz_store.cc:276] 0709 12:27:04.251823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.800958 (+549135us) service_pool.cc:224] Handling call
0709 12:27:05.584543 (+783585us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54005ab754. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:05.584684 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416736128}
I20260709 12:27:05.699947  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:05.700209  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:05.700755  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.694001  8038 raft_consensus.cc:3060] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:05.702241  7161 raft_consensus.cc:1275] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:05.656432  7082 rpcz_store.cc:276] 0709 12:27:03.088678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.137289 (+2048611us) service_pool.cc:224] Handling call
0709 12:27:05.137814 (+   525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:05.138361 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.138417 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:05.139144 (+   727us) log.cc:844] Serialized 26 byte log entry
0709 12:27:05.329761 (+190617us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:05.488150 (+158389us) log.cc:844] Serialized 14 byte log entry
0709 12:27:05.524818 (+ 36668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.532123 (+  7305us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:05.535050 (+  2927us) raft_consensus.cc:1685] finished
0709 12:27:05.535073 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.548708 (+ 13635us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":196002,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":19277,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":4576,"thread_start_us":296040,"threads_started":2,"wal-append.queue_time_us":216997}
I20260709 12:27:05.702446  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.640239  7090 rpcz_store.cc:276] 0709 12:27:04.469872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.527944 (+1058072us) service_pool.cc:224] Handling call
0709 12:27:05.577756 (+ 49812us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.639395 (+ 61639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.639623 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:05.661687  7981 consensus_queue.cc:260] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:05.709133  7088 raft_consensus.cc:2468] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:27:05.700906  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.704411  8082 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:05.694396  8076 raft_consensus.cc:493] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:05.715803  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
W20260709 12:27:05.708271  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 48013.9us
I20260709 12:27:05.721143  7055 leader_election.cc:304] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:05.722635  7055 leader_election.cc:304] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:05.726111  7055 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:05.712994  7673 leader_election.cc:290] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:05.714085  7084 raft_consensus.cc:3060] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.727265  7008 raft_consensus.cc:2468] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:27:05.724359  8076 raft_consensus.cc:3060] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.724010  8012 raft_consensus.cc:2749] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:05.727773  8022 raft_consensus.cc:2749] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:05.728276  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:05.765916  7087 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 217) took 1124 ms. Trace:
I20260709 12:27:05.766566  7131 leader_election.cc:304] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:05.767788  7131 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:05.768473  8084 raft_consensus.cc:515] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:05.773173  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.774029  7090 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 216) took 1155 ms. Trace:
I20260709 12:27:05.774499  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.774433  7090 rpcz_store.cc:276] 0709 12:27:04.618213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.727921 (+1109708us) service_pool.cc:224] Handling call
0709 12:27:05.773101 (+ 45180us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:05.773297 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.773652 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.773683 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.773734 (+    51us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:27:05.773763 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.773843 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.773973 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8718208}
I20260709 12:27:05.775749  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.776463  7090 raft_consensus.cc:3060] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:05.734086  7883 raft_consensus.cc:2804] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:05.776990  7883 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:05.777402  7883 raft_consensus.cc:3060] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:05.750927  7089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 206) took 1281 ms. Trace:
I20260709 12:27:05.742578  8032 raft_consensus.cc:493] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:05.754592  8107 raft_consensus.cc:515] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:05.757635  7085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 197) took 2670 ms. Trace:
I20260709 12:27:05.758935  7985 raft_consensus.cc:515] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:05.740449  7014 raft_consensus.cc:2410] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:05.761404  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.761818  7159 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:05.729704  7234 raft_consensus.cc:2468] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:05.735734  7981 raft_consensus.cc:3060] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.812489  7131 leader_election.cc:304] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:05.818835  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:05.878194  7239 raft_consensus.cc:2410] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260709 12:27:05.870146  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 43934.1us
I20260709 12:27:05.879451  7205 leader_election.cc:304] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:05.881270  7205 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:05.824433  6980 leader_election.cc:304] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:05.874336  7284 tablet_bootstrap.cc:492] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca: No bootstrap required, opened a new log
I20260709 12:27:05.876080  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:05.822613  8032 raft_consensus.cc:515] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:05.884418  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 60077.7us
I20260709 12:27:05.895037  7205 leader_election.cc:304] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:05.884688  7284 ts_tablet_manager.cc:1403] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca: Time spent bootstrapping tablet: real 0.859s	user 0.026s	sys 0.024s
I20260709 12:27:05.895568  7091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46248 (request call id 162) took 2766 ms. Trace:
W20260709 12:27:05.900084  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 87714.3us
I20260709 12:27:05.908113  7091 rpcz_store.cc:276] 0709 12:27:03.129563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.502955 (+2373392us) service_pool.cc:224] Handling call
0709 12:27:05.894944 (+391989us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:05.895118 (+   174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.895277 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.895302 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.895340 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:05.895369 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.895417 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.895516 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2520320}
I20260709 12:27:05.911774  7131 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:05.902261  6980 leader_election.cc:304] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:05.918453  6980 leader_election.cc:304] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:05.920047  7131 leader_election.cc:400] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Vote denied by peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713) with higher term. Message: Invalid argument: T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for earlier term 3. Current term is 4.
I20260709 12:27:05.920570  7131 leader_election.cc:403] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:27:05.923240  7131 leader_election.cc:304] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:05.820291  7903 raft_consensus.cc:2804] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:05.922698  7055 leader_election.cc:304] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:05.927456  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:05.928869  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:05.929625  8038 raft_consensus.cc:515] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:05.930207  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:05.931188  7885 raft_consensus.cc:2749] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713) with higher term. Message: Invalid argument: T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for earlier term 3. Current term is 4.
I20260709 12:27:05.931489  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:05.932065  8038 leader_election.cc:290] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:05.822777  8007 raft_consensus.cc:2804] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:05.935565  7129 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:05.933254  7205 leader_election.cc:304] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:05.766294  7087 rpcz_store.cc:276] 0709 12:27:04.641296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.765089 (+1123793us) service_pool.cc:224] Handling call
0709 12:27:05.765418 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.765602 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.765628 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.765668 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:05.765702 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.765757 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.765860 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:05.820916  7237 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:05.941952  8038 raft_consensus.cc:2749] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:05.942373  7055 leader_election.cc:304] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:05.918167  7673 raft_consensus.cc:2804] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:05.923221  7943 raft_consensus.cc:2804] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:05.892267  8107 leader_election.cc:290] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:05.934751  7930 raft_consensus.cc:2804] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:05.891304  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:05.891093  8032 leader_election.cc:290] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:05.907688  8082 raft_consensus.cc:2804] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:05.891625  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:05.886327  8084 leader_election.cc:290] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:05.887465  8094 raft_consensus.cc:493] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:05.946743  8080 raft_consensus.cc:3055] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:05.976877  8080 raft_consensus.cc:740] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:05.977993  8080 consensus_queue.cc:260] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:05.978936  8080 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:05.959970  8040 raft_consensus.cc:2804] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:05.980816  8040 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:05.981202  8040 raft_consensus.cc:3060] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.981417  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:05.983096  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:05.899677  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.898273  8036 raft_consensus.cc:2804] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:05.962636  7011 raft_consensus.cc:2393] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 2: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:05.955559  6980 leader_election.cc:304] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:05.935740  7971 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.890985  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:05.963961  7055 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:05.965597  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:05.908308  8072 raft_consensus.cc:2804] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:05.966492  7930 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:05.990106  8094 raft_consensus.cc:3060] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.960603  8020 raft_consensus.cc:2804] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:05.972931  8082 raft_consensus.cc:493] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:05.974190  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.975082  7883 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:05.959316  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:05.976372  7650 leader_election.cc:290] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:05.946435  8028 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.939556  8007 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:05.942202  8009 raft_consensus.cc:2804] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:05.950783  7940 raft_consensus.cc:2804] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:27:06.018568  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 63108.4us
I20260709 12:27:05.956575  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:05.956832  7943 raft_consensus.cc:493] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:05.958959  7673 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:05.932752  8117 raft_consensus.cc:2804] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:05.990209  8076 raft_consensus.cc:515] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:06.097216  8076 leader_election.cc:290] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:05.809324  7089 rpcz_store.cc:276] 0709 12:27:04.469093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.513459 (+1044366us) service_pool.cc:224] Handling call
0709 12:27:05.513922 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.514214 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:27:05.612073 (+ 97859us) log.cc:844] Serialized 14 byte log entry
0709 12:27:05.750365 (+138292us) log.cc:844] Serialized 14 byte log entry
0709 12:27:05.750541 (+   176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.750601 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:05.750660 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.750733 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.750869 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5042,"prepare.queue_time_us":52030,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":19966,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":2117,"thread_start_us":149493,"threads_started":2,"wal-append.queue_time_us":294604}
I20260709 12:27:06.098430  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:06.099642  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:05.822474  7085 rpcz_store.cc:276] 0709 12:27:03.087725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.105104 (+2017379us) service_pool.cc:224] Handling call
0709 12:27:05.740928 (+635824us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:05.756876 (+ 15948us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.757147 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.757190 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.757253 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:05.757308 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.757393 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.757556 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13576576}
I20260709 12:27:06.101651  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:06.102152  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:06.102937  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:06.103518  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:06.086638  8028 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:06.104112  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:06.106244  7990 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:06.089598  8009 raft_consensus.cc:493] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:05.954887  7788 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:06.107307  8009 raft_consensus.cc:3060] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.088616  8007 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:06.107671  8117 raft_consensus.cc:493] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:06.108167  8117 raft_consensus.cc:3060] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.961230  8113 consensus_queue.cc:1059] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.068s
I20260709 12:27:05.998806  8036 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:06.046166  7202 leader_election.cc:304] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:06.045127  8082 raft_consensus.cc:3060] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.026105  7971 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:06.017912  7084 raft_consensus.cc:2468] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:06.028434  8107 raft_consensus.cc:2804] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:05.976668  8126 consensus_queue.cc:1048] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:27:06.043448  7159 raft_consensus.cc:1240] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:06.032414  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:06.029458  8084 raft_consensus.cc:2749] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:06.035794  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:06.038482  7930 raft_consensus.cc:3060] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.092414  7091 raft_consensus.cc:1240] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:06.024921  8017 consensus_queue.cc:1059] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:27:06.115415  7940 raft_consensus.cc:697] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:06.039146  7087 raft_consensus.cc:1240] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:06.036679  8072 raft_consensus.cc:493] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:06.038766  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:06.094836  7943 raft_consensus.cc:3060] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.095250  7673 raft_consensus.cc:3060] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.105844  7883 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:06.089552  8022 raft_consensus.cc:2804] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:06.028913  8038 consensus_queue.cc:1059] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:27:06.044883  8020 raft_consensus.cc:493] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:06.055881  6982 leader_election.cc:304] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:06.115547  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
W20260709 12:27:06.164598  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 200751us
I20260709 12:27:06.168979  7016 raft_consensus.cc:3060] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.100291  7089 raft_consensus.cc:2468] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
W20260709 12:27:06.169945  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 114195us
W20260709 12:27:06.171494  7205 leader_election.cc:343] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:06.131827  7015 raft_consensus.cc:2468] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:27:06.111198  8036 raft_consensus.cc:3060] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.107312  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:27:06.138177  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 200621us
I20260709 12:27:06.093132  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:06.107504  8028 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:27:06.145229  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 209745us
W20260709 12:27:06.161711  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:27:06.161993  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 115930us
I20260709 12:27:06.135246  7951 raft_consensus.cc:2749] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:06.141613  7083 raft_consensus.cc:1240] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:06.137656  7690 raft_consensus.cc:2749] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: Vote denied by peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743) with higher term. Message: Invalid argument: T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2.
I20260709 12:27:06.120823  7903 raft_consensus.cc:697] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [term 4 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:06.141980  7985 leader_election.cc:290] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:06.143695  8072 raft_consensus.cc:3060] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.170038  7008 raft_consensus.cc:2393] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 2: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:06.182480  7205 leader_election.cc:304] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:06.189433  7129 leader_election.cc:304] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:06.160571  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:06.168248  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:06.169431  8020 raft_consensus.cc:3060] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.170539  8022 raft_consensus.cc:697] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:06.170270  7788 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:06.214150  7129 leader_election.cc:304] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:06.208294  8127 log.cc:927] Time spent T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
W20260709 12:27:06.226707  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 56044.9us
I20260709 12:27:06.188580  7230 raft_consensus.cc:2468] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:06.229198  7284 raft_consensus.cc:359] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:06.242902  7284 raft_consensus.cc:385] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:06.243741  8140 raft_consensus.cc:2804] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:06.243839  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:06.217778  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:06.216121  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:06.251267  7084 raft_consensus.cc:2393] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 4: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:06.213517  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:06.217063  8128 raft_consensus.cc:2749] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:06.266148  6982 leader_election.cc:304] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:06.270035  7016 raft_consensus.cc:2468] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:06.263983  7284 raft_consensus.cc:740] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Initialized, Role: FOLLOWER
I20260709 12:27:06.220371  8107 raft_consensus.cc:697] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:06.252328  8129 raft_consensus.cc:2749] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:06.252669  7788 raft_consensus.cc:2804] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:06.289377  7128 leader_election.cc:304] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:06.276051  7234 raft_consensus.cc:1240] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:06.288373  7284 consensus_queue.cc:260] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:06.252521  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:06.280807  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:06.292972  8131 log.cc:927] Time spent T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:27:06.297446  6980 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:06.216881  7940 consensus_queue.cc:237] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:06.279496  8140 raft_consensus.cc:697] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:06.307147  7284 ts_tablet_manager.cc:1434] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca: Time spent starting tablet: real 0.400s	user 0.007s	sys 0.002s
I20260709 12:27:06.289237  7087 raft_consensus.cc:3060] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:06.306798  7085 raft_consensus.cc:2393] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 2: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:06.273739  8132 consensus_queue.cc:1059] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 12:27:06.314273  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:06.296854  7788 raft_consensus.cc:493] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
W20260709 12:27:06.323397  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 94482.4us
I20260709 12:27:06.324158  6982 leader_election.cc:304] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:06.306986  8129 raft_consensus.cc:2804] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:06.330283  8094 raft_consensus.cc:515] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:06.331574  7237 raft_consensus.cc:1240] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:06.335105  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:06.335536  8017 raft_consensus.cc:3055] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:06.335992  8017 raft_consensus.cc:740] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
W20260709 12:27:06.470171  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 119618us
I20260709 12:27:06.319927  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:06.312155  7160 raft_consensus.cc:2468] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:06.329213  7788 raft_consensus.cc:3060] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:06.591180  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 115480us
I20260709 12:27:06.333870  7012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 207) took 1144 ms. Trace:
I20260709 12:27:06.286243  7903 consensus_queue.cc:237] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:06.328804  7985 raft_consensus.cc:2804] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:06.307493  8007 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:06.597959  7165 raft_consensus.cc:1240] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:06.336266  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:06.297125  8022 consensus_queue.cc:237] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:06.315634  8148 raft_consensus.cc:2749] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:06.602932  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.333570  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
W20260709 12:27:06.605743  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 316437us
I20260709 12:27:06.450245  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:06.470464  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:06.613950  8150 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:06.624903  8150 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:06.627060  8150 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:06.476131  8129 raft_consensus.cc:697] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:06.629655  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:06.631279  8009 consensus_meta.cc:287] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.000s
I20260709 12:27:06.631703  8009 raft_consensus.cc:515] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:06.627969  7673 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:06.633975  7673 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:06.451469  8040 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:06.596448  8142 raft_consensus.cc:2749] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:06.618844  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:06.815347  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:06.803653  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:06.607218  7012 rpcz_store.cc:276] 0709 12:27:05.189364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.193369 (+  4005us) service_pool.cc:224] Handling call
0709 12:27:05.244589 (+ 51220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.638196 (+393607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.333585 (+695389us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b540013bfd4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:06.333799 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651731200}
I20260709 12:27:06.602686  7054 leader_election.cc:304] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:06.846949  7008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34216 (request call id 285) took 1148 ms. Trace:
I20260709 12:27:06.847572  7008 rpcz_store.cc:276] 0709 12:27:05.698663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.602198 (+903535us) service_pool.cc:224] Handling call
0709 12:27:06.846809 (+244611us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:06.595501  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:06.849925  7014 raft_consensus.cc:2393] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 4: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:06.850586  7011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34232 (request call id 217) took 1462 ms. Trace:
I20260709 12:27:06.851186  7011 rpcz_store.cc:276] 0709 12:27:05.387507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.387661 (+   154us) service_pool.cc:224] Handling call
0709 12:27:06.850099 (+1462438us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b540036e2d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:06.850349 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1141348608}
I20260709 12:27:06.852100  8139 raft_consensus.cc:2749] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:06.853464  7128 leader_election.cc:304] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:06.854329  7013 raft_consensus.cc:1240] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:06.600894  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:06.856441  8153 raft_consensus.cc:3060] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.808454  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:06.861100  8136 raft_consensus.cc:493] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:06.861646  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:06.862033  8136 raft_consensus.cc:515] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:06.863883  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:06.815366  7158 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56784 (request call id 153) took 1445 ms. Trace:
I20260709 12:27:06.865156  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:06.865504  7158 rpcz_store.cc:276] 0709 12:27:05.369689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.381758 (+ 12069us) service_pool.cc:224] Handling call
0709 12:27:06.618642 (+1236884us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:06.814953 (+196311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27312896}
I20260709 12:27:06.865922  7015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34216 (request call id 292) took 1165 ms. Trace:
I20260709 12:27:06.617890  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:06.866788  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:06.867362  8135 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:06.867883  7008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34216 (request call id 291) took 1167 ms. Trace:
I20260709 12:27:06.868232  8135 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:06.636085  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
W20260709 12:27:06.872728  7233 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 114) took 1586 ms (client timeout 1885 ms). Trace:
I20260709 12:27:06.823580  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:06.827133  7232 raft_consensus.cc:1240] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:06.827488  8022 raft_consensus.cc:493] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.831115  7845 raft_consensus.cc:493] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.611901  7985 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:06.880833  7985 raft_consensus.cc:3060] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:06.615795  8017 consensus_queue.cc:260] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:06.886456  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:06.886668  8022 raft_consensus.cc:515] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:06.887884  7012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34216 (request call id 279) took 1190 ms. Trace:
I20260709 12:27:06.889671  8022 leader_election.cc:290] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:06.745573  8009 leader_election.cc:290] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:06.595237  8038 consensus_queue.cc:1059] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 12:27:06.748672  8072 consensus_meta.cc:287] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.003s
I20260709 12:27:06.894536  8072 raft_consensus.cc:515] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:06.895771  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:06.896976  7236 raft_consensus.cc:1240] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
W20260709 12:27:06.637467  8080 consensus_meta.cc:287] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 0.658s	user 0.012s	sys 0.000s
I20260709 12:27:06.897598  7845 raft_consensus.cc:515] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:06.898622  8080 consensus_queue.cc:1059] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:06.615028  8032 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.901635  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:06.902140  8058 raft_consensus.cc:3055] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:06.595013  8107 consensus_queue.cc:237] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:06.747257  8040 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:06.902689  8058 raft_consensus.cc:740] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
W20260709 12:27:06.758785  8117 consensus_meta.cc:287] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 0.650s	user 0.004s	sys 0.004s
I20260709 12:27:06.891464  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:06.904464  8117 raft_consensus.cc:515] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:06.891487  7232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49174 (request call id 206) took 1105 ms. Trace:
I20260709 12:27:06.906342  7232 rpcz_store.cc:276] 0709 12:27:05.785745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.944428 (+158683us) service_pool.cc:224] Handling call
0709 12:27:06.000215 (+ 55787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.883937 (+883722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.891100 (+  7163us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b54000c67d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:06.891391 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1899950464}
I20260709 12:27:06.907087  8117 leader_election.cc:290] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:06.802908  7007 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:06.907605  7845 leader_election.cc:290] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:06.909291  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:06.636030  8140 consensus_queue.cc:237] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:06.628360  8129 consensus_queue.cc:237] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:06.908432  8106 raft_consensus.cc:3055] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:06.917937  8106 raft_consensus.cc:740] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
W20260709 12:27:06.721243  8143 log.cc:927] Time spent T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
W20260709 12:27:06.755231  8020 consensus_meta.cc:287] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.000s
W20260709 12:27:06.765638  8082 consensus_meta.cc:287] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 0.635s	user 0.011s	sys 0.000s
W20260709 12:27:06.835608  8028 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.009s	sys 0.023s
W20260709 12:27:06.968075  8028 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.009s	sys 0.024s
I20260709 12:27:06.968194  8082 raft_consensus.cc:515] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:06.968896  7158 raft_consensus.cc:1240] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:06.970599  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:06.970882  8082 leader_election.cc:290] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:06.841224  7084 raft_consensus.cc:2468] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:06.848064  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
W20260709 12:27:06.873324  7233 rpcz_store.cc:269] 0709 12:27:05.286192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.401096 (+114904us) service_pool.cc:224] Handling call
0709 12:27:06.617019 (+1215923us) spinlock_profiling.cc:243] Waited 6.89 ms on lock 0x7b5800010298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:06.872437 (+255418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15853824}
I20260709 12:27:06.973251  7009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34210 (request call id 111) took 1150 ms. Trace:
I20260709 12:27:06.973873  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:06.973671  8020 raft_consensus.cc:515] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:06.974082  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:27:06.951025  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 245875us
I20260709 12:27:06.868353  7008 rpcz_store.cc:276] 0709 12:27:05.700169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.866357 (+1166188us) service_pool.cc:224] Handling call
0709 12:27:06.867795 (+  1438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:06.975708  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:06.975783  7054 leader_election.cc:304] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:06.976835  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:06.977425  7202 leader_election.cc:304] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:06.977986  7054 leader_election.cc:304] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:06.978071  7008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34216 (request call id 280) took 1280 ms. Trace:
I20260709 12:27:06.926373  8058 consensus_queue.cc:260] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:06.902503  8032 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:06.909452  8111 raft_consensus.cc:3055] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:06.979640  8111 raft_consensus.cc:740] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:06.980079  8058 raft_consensus.cc:3060] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.981127  8032 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:06.743989  8146 log.cc:927] Time spent T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:27:06.980978  8111 consensus_queue.cc:260] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:06.868045  7235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 108) took 1636 ms. Trace:
I20260709 12:27:06.873911  7086 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46248 (request call id 163) took 3743 ms. Trace:
I20260709 12:27:06.937245  8031 raft_consensus.cc:493] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:06.912626  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:06.902751  7230 raft_consensus.cc:2468] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:27:06.888461  7012 rpcz_store.cc:276] 0709 12:27:05.697244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.885704 (+1188460us) service_pool.cc:224] Handling call
0709 12:27:06.887769 (+  2065us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:06.926702  8080 raft_consensus.cc:3055] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:27:06.955487  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 122071us
W20260709 12:27:06.961750  8036 consensus_meta.cc:287] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.773s	user 0.013s	sys 0.001s
I20260709 12:27:06.963693  8153 raft_consensus.cc:2749] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:06.963855  7205 leader_election.cc:304] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:06.964232  8135 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:06.965067  8136 leader_election.cc:290] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:06.964999  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:06.965533  8072 leader_election.cc:290] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:06.977063  8009 raft_consensus.cc:2749] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:06.997987  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:06.998029  7011 raft_consensus.cc:2468] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:06.998710  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:06.999195  7158 raft_consensus.cc:2393] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 4: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:06.999197  7011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34216 (request call id 278) took 1302 ms. Trace:
I20260709 12:27:07.000149  7011 rpcz_store.cc:276] 0709 12:27:05.696964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.947101 (+1250137us) service_pool.cc:224] Handling call
0709 12:27:06.999117 (+ 52016us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:06.973259  8106 consensus_queue.cc:260] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:06.866559  7015 rpcz_store.cc:276] 0709 12:27:05.700417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.707871 (+  7454us) service_pool.cc:224] Handling call
0709 12:27:06.865461 (+1157590us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b5400047254. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:06.865703 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872442240}
I20260709 12:27:07.001965  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:07.002624  8031 raft_consensus.cc:515] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:07.002971  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:07.003858  7015 raft_consensus.cc:2393] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 2: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:07.004921  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:07.005062  8022 raft_consensus.cc:2749] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:07.005981  8031 leader_election.cc:290] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:06.982966  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:06.995391  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:06.973691  7009 rpcz_store.cc:276] 0709 12:27:05.823009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.252266 (+429257us) service_pool.cc:224] Handling call
0709 12:27:06.847597 (+595331us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b58001b0698. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:06.973175 (+125578us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9507200}
I20260709 12:27:06.993672  8080 raft_consensus.cc:740] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:06.989259  7086 rpcz_store.cc:276] 0709 12:27:03.129928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.507716 (+2377788us) service_pool.cc:224] Handling call
0709 12:27:05.543776 (+ 36060us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.112869 (+569093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.115810 (+  2941us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:06.121925 (+  6115us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:27:06.130514 (+  8589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.136701 (+  6187us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:06.873464 (+736763us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b54006d24d0. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782138ad 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:06.873698 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49575,"spinlock_wait_cycles":77989888}
I20260709 12:27:07.008436  8110 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:07.009140  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:07.009718  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:07.010140  7009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34210 (request call id 123) took 1031 ms. Trace:
I20260709 12:27:07.000474  7160 raft_consensus.cc:1240] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.012502  7009 rpcz_store.cc:276] 0709 12:27:05.978419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.008756 (+1030337us) service_pool.cc:224] Handling call
0709 12:27:07.010074 (+  1318us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.022280  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:07.023254  7090 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 221) took 1854 ms. Trace:
W20260709 12:27:07.023528  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 45715.6us
I20260709 12:27:07.009599  8080 consensus_queue.cc:260] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:06.978698  7008 rpcz_store.cc:276] 0709 12:27:05.697485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.976335 (+1278850us) service_pool.cc:224] Handling call
0709 12:27:06.978007 (+  1672us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.028786  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:07.016152  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:07.029516  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:07.030232  7158 raft_consensus.cc:2468] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:07.030435  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:07.030817  7084 raft_consensus.cc:2410] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:27:07.031253  7008 raft_consensus.cc:3060] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.031939  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:06.976320  8020 leader_election.cc:290] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:07.034969  6979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.975373  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:07.037590  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:07.038422  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:07.039449  7160 raft_consensus.cc:3060] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.041356  7985 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:07.041885  8153 consensus_queue.cc:1059] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:07.042847  7009 raft_consensus.cc:2393] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 4: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:07.043390  7885 raft_consensus.cc:3055] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:07.043932  7885 raft_consensus.cc:740] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:07.045758  8080 raft_consensus.cc:3060] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.999593  7012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34210 (request call id 115) took 1102 ms. Trace:
I20260709 12:27:07.046406  7202 leader_election.cc:304] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:07.006199  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:07.047493  7015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34210 (request call id 119) took 1111 ms. Trace:
I20260709 12:27:07.047559  8040 raft_consensus.cc:2749] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:07.015213  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:07.048908  7157 raft_consensus.cc:3060] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:07.049054  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 54789.3us
I20260709 12:27:07.001595  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:07.016834  8072 raft_consensus.cc:2749] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:07.050272  7011 raft_consensus.cc:2393] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 2: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:07.002060  8106 raft_consensus.cc:3060] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.918056  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:27:07.016884  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 53459.1us
I20260709 12:27:07.023774  7090 rpcz_store.cc:276] 0709 12:27:05.168617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.775979 (+607362us) service_pool.cc:224] Handling call
0709 12:27:05.776301 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:06.018505 (+242204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.018532 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:06.018989 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:27:06.274585 (+255596us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:06.301164 (+ 26579us) log.cc:844] Serialized 14 byte log entry
0709 12:27:06.301616 (+   452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.301700 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.022621 (+720921us) raft_consensus.cc:1685] finished
0709 12:27:07.022654 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.023061 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16704,"prepare.queue_time_us":341639,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":2438,"raft.queue_time_us":44931,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":39658,"thread_start_us":281332,"threads_started":2,"wal-append.queue_time_us":310705}
I20260709 12:27:07.045292  7885 consensus_queue.cc:260] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:07.046362  7012 rpcz_store.cc:276] 0709 12:27:05.897039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.998353 (+1101314us) service_pool.cc:224] Handling call
0709 12:27:06.999536 (+  1183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.006788  8028 raft_consensus.cc:2749] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:07.019354  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:06.988933  7235 rpcz_store.cc:276] 0709 12:27:05.231479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.238358 (+  6879us) service_pool.cc:224] Handling call
0709 12:27:06.609022 (+1370664us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b5800010298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:06.867737 (+258715us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7300352}
I20260709 12:27:07.047890  7015 rpcz_store.cc:276] 0709 12:27:05.936168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.005907 (+1069739us) service_pool.cc:224] Handling call
0709 12:27:07.047432 (+ 41525us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.050761  7011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34232 (request call id 233) took 1068 ms. Trace:
I20260709 12:27:07.057955  7011 rpcz_store.cc:276] 0709 12:27:05.982431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.001223 (+1018792us) service_pool.cc:224] Handling call
0709 12:27:07.050700 (+ 49477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.059165  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:07.059794  7011 raft_consensus.cc:2468] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
W20260709 12:27:07.053166  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.057456  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:07.061996  8017 raft_consensus.cc:3060] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:07.063014  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:07.064260  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:07.065650  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:07.070479  7165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56794 (request call id 207) took 2059 ms. Trace:
I20260709 12:27:07.012245  7086 raft_consensus.cc:3060] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.074245  7016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34232 (request call id 230) took 1374 ms. Trace:
I20260709 12:27:07.044355  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:07.067472  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:07.079035  7165 rpcz_store.cc:276] 0709 12:27:05.010481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.182714 (+172233us) service_pool.cc:224] Handling call
0709 12:27:05.897052 (+714338us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:05.897333 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.612129 (+714796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.069932 (+457803us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b540082d054. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:07.070270 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1616050176}
I20260709 12:27:07.080076  7016 rpcz_store.cc:276] 0709 12:27:05.699647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.858268 (+1158621us) service_pool.cc:224] Handling call
0709 12:27:07.018964 (+160696us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b58001b0698. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:07.074181 (+ 55217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36984576}
I20260709 12:27:07.110823  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:07.081453  7085 raft_consensus.cc:2393] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 4: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
W20260709 12:27:07.111739  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.114451  8107 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:07.115180  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:07.116101  7202 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:07.097348  7084 raft_consensus.cc:3060] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.113176  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:07.125829  7159 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.002s	sys 0.038s
W20260709 12:27:07.127182  7159 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.003s	sys 0.039s
I20260709 12:27:07.128748  8107 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:07.131203  8107 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:07.054527  8036 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:07.132726  7054 leader_election.cc:304] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
W20260709 12:27:07.123620  7981 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.002s	sys 0.029s
W20260709 12:27:07.135483  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 54389.5us
I20260709 12:27:07.137050  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:07.116783  7234 raft_consensus.cc:2468] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:07.142112  7007 raft_consensus.cc:2410] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:27:07.142884  8144 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.143267  7788 raft_consensus.cc:515] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:07.143556  8144 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:07.144802  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:07.145941  7788 leader_election.cc:290] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:07.148803  7128 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:07.150360  7082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 212) took 2679 ms. Trace:
I20260709 12:27:07.150767  7236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49174 (request call id 205) took 1365 ms. Trace:
I20260709 12:27:07.151262  7236 rpcz_store.cc:276] 0709 12:27:05.785419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.882792 (+1097373us) service_pool.cc:224] Handling call
0709 12:27:06.883382 (+   590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.897559 (+ 14177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.150500 (+252941us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b540075b2d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:07.150685 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30301056}
I20260709 12:27:07.151961  8132 raft_consensus.cc:2749] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:07.152709  7885 raft_consensus.cc:3060] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:07.152956  7943 consensus_meta.cc:287] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 0.985s	user 0.017s	sys 0.002s
I20260709 12:27:07.153414  7943 raft_consensus.cc:515] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:07.157151  7231 raft_consensus.cc:1240] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
W20260709 12:27:07.138069  7981 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.002s	sys 0.030s
I20260709 12:27:07.154704  7016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34210 (request call id 107) took 1425 ms. Trace:
I20260709 12:27:07.155915  7990 raft_consensus.cc:2749] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:07.161312  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:07.159101  7016 rpcz_store.cc:276] 0709 12:27:05.729431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.120683 (+1391252us) service_pool.cc:224] Handling call
0709 12:27:07.154649 (+ 33966us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.159933  7951 raft_consensus.cc:2804] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:07.160391  8094 leader_election.cc:290] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:07.163815  7232 raft_consensus.cc:1240] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
W20260709 12:27:07.164105  7971 consensus_meta.cc:287] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 1.030s	user 0.015s	sys 0.003s
I20260709 12:27:07.164215  7161 raft_consensus.cc:1240] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.164575  7971 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:07.163864  7943 leader_election.cc:290] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:07.142882  7007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34210 (request call id 112) took 1246 ms. Trace:
I20260709 12:27:07.150785  7082 rpcz_store.cc:276] 0709 12:27:04.470986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.724817 (+1253831us) service_pool.cc:224] Handling call
0709 12:27:07.136369 (+1411552us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:07.149481 (+ 13112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.149819 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.149863 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.149932 (+    69us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:07.149970 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.150037 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.150187 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13502208}
I20260709 12:27:07.168398  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:07.169924  8007 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:27:07.171490  7130 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.171630  7159 raft_consensus.cc:2468] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:27:07.167148  7083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 211) took 2696 ms. Trace:
I20260709 12:27:07.172690  7083 rpcz_store.cc:276] 0709 12:27:04.470613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.724656 (+1254043us) service_pool.cc:224] Handling call
0709 12:27:06.130440 (+405784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.198019 (+ 67579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.166664 (+968645us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54005abc50. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782138ad 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:07.166941 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":871998848}
I20260709 12:27:07.174152  8036 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:07.174492  7083 raft_consensus.cc:1240] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.175256  7083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 212) took 1854 ms. Trace:
I20260709 12:27:07.176209  7158 raft_consensus.cc:2468] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:07.176575  7083 rpcz_store.cc:276] 0709 12:27:05.320571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.173770 (+1853199us) service_pool.cc:224] Handling call
0709 12:27:07.174210 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.174973 (+   763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.175182 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.177070  7090 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 209) took 1879 ms. Trace:
I20260709 12:27:07.177443  7090 rpcz_store.cc:276] 0709 12:27:05.297353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.176078 (+1878725us) service_pool.cc:224] Handling call
0709 12:27:07.176428 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.176709 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.176735 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.176802 (+    67us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:07.176861 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.176915 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.177004 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.178184  7083 raft_consensus.cc:1275] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:27:07.178583  7083 pending_rounds.cc:85] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca: Aborting all ops after (but not including) 1
I20260709 12:27:07.178889  7083 pending_rounds.cc:107] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:27:07.179253  7083 raft_consensus.cc:2889] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:07.178692  7202 leader_election.cc:304] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:07.166708  7007 rpcz_store.cc:276] 0709 12:27:05.895997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.299847 (+403850us) service_pool.cc:224] Handling call
0709 12:27:07.142783 (+842936us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.180068  7083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 214) took 1841 ms. Trace:
I20260709 12:27:07.175879  7016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 281) took 1478 ms. Trace:
I20260709 12:27:07.180943  7159 raft_consensus.cc:1240] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.181488  7082 raft_consensus.cc:1240] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:27:07.187018  7930 consensus_meta.cc:287] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 1.032s	user 0.011s	sys 0.005s
W20260709 12:27:07.187320  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 137092us
I20260709 12:27:07.187814  7086 raft_consensus.cc:2468] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:07.195652  7085 raft_consensus.cc:1240] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:27:07.197008  7085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 203) took 1968 ms. Trace:
I20260709 12:27:07.197512  7091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 224) took 2028 ms. Trace:
I20260709 12:27:07.197410  7085 rpcz_store.cc:276] 0709 12:27:05.228773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.146741 (+1917968us) service_pool.cc:224] Handling call
0709 12:27:07.195383 (+ 48642us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:07.196051 (+   668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.196756 (+   705us) spinlock_profiling.cc:243] Waited 46.2 ms on lock 0x7b54007fe4d0. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782138ad 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:07.196926 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106350464}
I20260709 12:27:07.198155  7091 rpcz_store.cc:276] 0709 12:27:05.169415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.945483 (+776068us) service_pool.cc:224] Handling call
0709 12:27:05.950024 (+  4541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.140296 (+190272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.197085 (+1056789us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400250dd4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:07.197359 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326937984}
I20260709 12:27:07.199195  7085 raft_consensus.cc:1240] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.199717  7091 raft_consensus.cc:3060] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.200053  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:07.201550  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:07.202000  7926 raft_consensus.cc:3055] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:07.202459  7926 raft_consensus.cc:740] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
W20260709 12:27:07.188781  7087 consensus_meta.cc:287] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.844s	user 0.015s	sys 0.003s
I20260709 12:27:07.203261  7087 raft_consensus.cc:2468] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 4.
I20260709 12:27:07.203568  7926 consensus_queue.cc:260] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:07.204385  7087 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46248 (request call id 170) took 1219 ms. Trace:
I20260709 12:27:07.204806  7087 rpcz_store.cc:276] 0709 12:27:05.985149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.187526 (+202377us) service_pool.cc:224] Handling call
0709 12:27:07.204282 (+1016756us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.210506  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:07.211267  7238 raft_consensus.cc:2468] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
W20260709 12:27:07.211841  7238 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 105) took 1981 ms (client timeout 1514 ms). Trace:
I20260709 12:27:07.213294  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:07.214589  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:07.215205  7012 raft_consensus.cc:1240] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:07.215989  7012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 284) took 1517 ms. Trace:
I20260709 12:27:07.190917  7015 raft_consensus.cc:2410] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:27:07.180495  7090 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 216) took 1834 ms. Trace:
I20260709 12:27:07.167644  7008 raft_consensus.cc:2468] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:07.192015  7082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 205) took 1953 ms. Trace:
W20260709 12:27:07.218770  7164 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56784 (request call id 150) took 2024 ms (client timeout 1683 ms). Trace:
I20260709 12:27:07.193286  8150 raft_consensus.cc:3060] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.194343  7202 leader_election.cc:304] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
W20260709 12:27:07.194330  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 61674.9us
I20260709 12:27:07.193943  7203 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
W20260709 12:27:07.219357  7164 rpcz_store.cc:269] 0709 12:27:05.193994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.221397 (+ 27403us) service_pool.cc:224] Handling call
0709 12:27:07.218446 (+1997049us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54000fe954. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:07.218585 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482326400}
I20260709 12:27:07.190045  7016 rpcz_store.cc:276] 0709 12:27:05.697720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.174813 (+1477093us) service_pool.cc:224] Handling call
0709 12:27:07.175209 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.175517 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.175555 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.175594 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:07.175644 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.175698 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.175793 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.217787  7090 rpcz_store.cc:276] 0709 12:27:05.348766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.178307 (+1829541us) service_pool.cc:224] Handling call
0709 12:27:07.178677 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.179004 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.179030 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.179088 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:07.179123 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.180354 (+  1231us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.180448 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.200088  7085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 217) took 1844 ms. Trace:
I20260709 12:27:07.225449  8140 raft_consensus.cc:2804] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:07.194378  7083 rpcz_store.cc:276] 0709 12:27:05.338295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.177497 (+1839202us) service_pool.cc:224] Handling call
0709 12:27:07.177816 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.179795 (+  1979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.179995 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.227064  7202 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:07.218727  7008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34232 (request call id 241) took 1111 ms. Trace:
I20260709 12:27:07.239063  7008 rpcz_store.cc:276] 0709 12:27:06.107382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.030038 (+922656us) service_pool.cc:224] Handling call
0709 12:27:07.218645 (+188607us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.239959  7673 consensus_queue.cc:1059] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:07.240361  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:07.227995  7054 leader_election.cc:304] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:07.191064  7951 raft_consensus.cc:697] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:07.167053  7971 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:07.218855  7082 rpcz_store.cc:276] 0709 12:27:05.238721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.169385 (+1930664us) service_pool.cc:224] Handling call
0709 12:27:07.170010 (+   625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:07.191650 (+ 21640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.191920 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:07.212263  7238 rpcz_store.cc:269] 0709 12:27:05.230409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.239033 (+  8624us) service_pool.cc:224] Handling call
0709 12:27:05.517659 (+278626us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b5800010298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:06.609782 (+1092123us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b5800010298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efe9c 00007f28750efa5b 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:07.210238 (+600456us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b5800010298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efeee 000000000036eb39 00007f287d1631e0 00007f287d22c0c4 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:07.211749 (+  1511us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34413056}
I20260709 12:27:07.250730  7013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 273) took 1562 ms. Trace:
I20260709 12:27:07.230945  7085 rpcz_store.cc:276] 0709 12:27:05.360463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.198597 (+1838134us) service_pool.cc:224] Handling call
0709 12:27:07.198945 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.199599 (+   654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.199860 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.170166  7011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34216 (request call id 289) took 1461 ms. Trace:
I20260709 12:27:07.251961  7011 rpcz_store.cc:276] 0709 12:27:05.699638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.060472 (+1360834us) service_pool.cc:224] Handling call
0709 12:27:07.161191 (+100719us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.251114  7013 rpcz_store.cc:276] 0709 12:27:05.688005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.688212 (+   207us) service_pool.cc:224] Handling call
0709 12:27:06.853483 (+1165271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.855132 (+  1649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.250496 (+395364us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540036e2d0. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782138ad 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:07.250655 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2661353344}
I20260709 12:27:07.232959  8140 raft_consensus.cc:493] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:07.189734  7985 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:07.235896  7670 raft_consensus.cc:2804] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:07.236466  8124 raft_consensus.cc:493] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.237701  7739 consensus_queue.cc:1048] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:07.238054  8040 consensus_queue.cc:1048] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:07.238458  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:07.191387  7161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56784 (request call id 158) took 1289 ms. Trace:
I20260709 12:27:07.240412  7203 leader_election.cc:304] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:07.193480  8036 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.241014  7673 raft_consensus.cc:3055] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:07.240775  8028 consensus_queue.cc:1059] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:27:07.241485  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:07.216353  7012 rpcz_store.cc:276] 0709 12:27:05.698408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.214602 (+1516194us) service_pool.cc:224] Handling call
0709 12:27:07.214984 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.215715 (+   731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.215910 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.239717  7926 raft_consensus.cc:3060] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.189052  7160 raft_consensus.cc:2468] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:07.247335  7951 consensus_queue.cc:237] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:07.247833  7129 leader_election.cc:304] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:07.248329  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:07.248593  8157 raft_consensus.cc:2749] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:07.240623  8160 consensus_queue.cc:1059] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:07.248926  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:07.249346  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:07.249660  7231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49174 (request call id 215) took 1324 ms. Trace:
I20260709 12:27:07.249936  7202 leader_election.cc:304] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:07.250427  7054 leader_election.cc:304] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:07.251070  7990 raft_consensus.cc:2749] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:07.194470  7930 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:07.255236  7083 raft_consensus.cc:1240] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:07.231550  8106 raft_consensus.cc:493] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:07.297659  8106 raft_consensus.cc:515] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:07.255565  8111 raft_consensus.cc:3060] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:07.257652  7235 raft_consensus.cc:1240] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:07.253468  7011 raft_consensus.cc:1240] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.189591  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:07.259684  7128 leader_election.cc:304] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:07.189621  8058 consensus_queue.cc:1059] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.054s
I20260709 12:27:07.309371  8058 raft_consensus.cc:3055] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:07.309799  8058 raft_consensus.cc:740] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:07.310784  8058 consensus_queue.cc:260] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:07.312127  8058 raft_consensus.cc:3060] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.300817  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:07.305162  7981 consensus_queue.cc:1059] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:27:07.315379  7981 raft_consensus.cc:3055] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:07.315852  7981 raft_consensus.cc:740] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
W20260709 12:27:07.316046  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 75715.5us
I20260709 12:27:07.317399  7203 leader_election.cc:304] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:07.317742  7739 consensus_queue.cc:1059] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:07.259827  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:07.262516  7090 raft_consensus.cc:1240] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:07.263299  7013 raft_consensus.cc:1240] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.255580  7008 raft_consensus.cc:1240] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3. Ops: []
W20260709 12:27:07.264577  8169 log.cc:927] Time spent T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:27:07.264573  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:07.263350  7670 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.269374  7015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34216 (request call id 293) took 1562 ms. Trace:
I20260709 12:27:07.270133  7016 raft_consensus.cc:1240] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.332274  7016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 286) took 1633 ms. Trace:
I20260709 12:27:07.261894  8140 raft_consensus.cc:3060] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:07.269516  7673 raft_consensus.cc:740] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:07.270779  8036 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:07.271210  7985 raft_consensus.cc:493] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:07.275432  7236 raft_consensus.cc:1240] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:27:07.279290  7165 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:27:07.288513  7159 raft_consensus.cc:3060] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.284838  7231 rpcz_store.cc:276] 0709 12:27:05.924841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.223729 (+298888us) service_pool.cc:224] Handling call
0709 12:27:06.250380 (+ 26651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.159844 (+909464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.249299 (+ 89455us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b54003e3354. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:07.249589 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2084457344}
W20260709 12:27:07.289367  7010 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34210 (request call id 105) took 1564 ms (client timeout 1954 ms). Trace:
I20260709 12:27:07.289548  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:07.291249  7054 leader_election.cc:304] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:07.291833  7156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56782 (request call id 142) took 1907 ms. Trace:
I20260709 12:27:07.292016  8009 raft_consensus.cc:3060] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:07.275590  8040 raft_consensus.cc:2804] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:07.294541  7163 raft_consensus.cc:1240] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.295576  7930 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:07.301988  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 81257.3us
I20260709 12:27:07.308455  7007 raft_consensus.cc:1240] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:07.329425  7008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 290) took 1629 ms. Trace:
I20260709 12:27:07.368707  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:07.332778  7090 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 229) took 1094 ms. Trace:
I20260709 12:27:07.369419  7007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 231) took 1412 ms. Trace:
I20260709 12:27:07.333142  7013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 288) took 1626 ms. Trace:
W20260709 12:27:07.370160  7014 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34210 (request call id 125) took 1391 ms (client timeout 1839 ms). Trace:
I20260709 12:27:07.370117  7013 rpcz_store.cc:276] 0709 12:27:05.699402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.253443 (+1554041us) service_pool.cc:224] Handling call
0709 12:27:07.260973 (+  7530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.322414 (+ 61441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.325767 (+  3353us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.370314  7985 raft_consensus.cc:515] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:07.370793  7014 rpcz_store.cc:269] 0709 12:27:05.978999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.851034 (+872035us) service_pool.cc:224] Handling call
0709 12:27:07.263155 (+412121us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b58001b0698. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:07.370095 (+106940us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39599360}
I20260709 12:27:07.372150  7013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 234) took 1389 ms. Trace:
I20260709 12:27:07.332819  7016 rpcz_store.cc:276] 0709 12:27:05.698917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.231582 (+1532665us) service_pool.cc:224] Handling call
0709 12:27:07.262069 (+ 30487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.331960 (+ 69891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.332205 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:07.373325  8171 log.cc:927] Time spent T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:27:07.373574  7016 raft_consensus.cc:1240] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.374168  7016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 236) took 1391 ms. Trace:
I20260709 12:27:07.374480  7016 rpcz_store.cc:276] 0709 12:27:05.983134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.372921 (+1389787us) service_pool.cc:224] Handling call
0709 12:27:07.373349 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.373945 (+   596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.374117 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.367553  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:07.321810  7158 raft_consensus.cc:2393] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 4: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:07.304836  8157 raft_consensus.cc:2749] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:07.384407  8020 raft_consensus.cc:2749] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:07.385810  6980 leader_election.cc:304] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:07.387209  8141 raft_consensus.cc:2749] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:07.387331  7055 leader_election.cc:304] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:07.388396  7690 consensus_queue.cc:1048] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:07.389631  7055 leader_election.cc:304] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:07.390308  7690 raft_consensus.cc:2749] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:07.390549  8135 raft_consensus.cc:2804] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:07.377697  8144 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:07.391068  8135 raft_consensus.cc:493] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:07.391469  8135 raft_consensus.cc:3060] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.343473  8150 raft_consensus.cc:2749] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:07.342408  8106 leader_election.cc:290] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:07.329833  7981 consensus_queue.cc:260] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:07.401362  7981 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:07.401706  7009 raft_consensus.cc:1240] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.402411  7009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 232) took 1420 ms. Trace:
I20260709 12:27:07.402748  7009 rpcz_store.cc:276] 0709 12:27:05.982140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.378726 (+1396586us) service_pool.cc:224] Handling call
0709 12:27:07.401474 (+ 22748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.402156 (+   682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.402355 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.400345  7012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34210 (request call id 108) took 1665 ms. Trace:
I20260709 12:27:07.405304  7985 leader_election.cc:290] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:07.405591  7055 leader_election.cc:304] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:07.407768  8036 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:07.408376  7990 raft_consensus.cc:2749] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:07.405035  7012 rpcz_store.cc:276] 0709 12:27:05.734566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.287463 (+1552897us) service_pool.cc:224] Handling call
0709 12:27:07.399641 (+112178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.399900 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.399941 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.400035 (+    94us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:07.400086 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.400152 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.400272 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.266782  7161 rpcz_store.cc:276] 0709 12:27:05.902280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.106423 (+204143us) service_pool.cc:224] Handling call
0709 12:27:06.106777 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.164786 (+1058009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.191065 (+ 26279us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540045b0d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:07.191326 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2424395136}
I20260709 12:27:07.334167  8072 raft_consensus.cc:3055] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:27:07.364933  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 120438us
I20260709 12:27:07.367357  7230 raft_consensus.cc:2468] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:07.367542  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:07.375125  8040 raft_consensus.cc:493] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:07.367869  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:07.349916  7156 rpcz_store.cc:276] 0709 12:27:05.383895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.429825 (+ 45930us) service_pool.cc:224] Handling call
0709 12:27:07.219875 (+1790050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.224321 (+  4446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.291394 (+ 67073us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54000fe950. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782138ad 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:07.291618 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4115665152}
I20260709 12:27:07.369670  7090 rpcz_store.cc:276] 0709 12:27:06.228139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.230227 (+1002088us) service_pool.cc:224] Handling call
0709 12:27:07.261291 (+ 31064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.321958 (+ 60667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.322194 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.330960  7015 rpcz_store.cc:276] 0709 12:27:05.708075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.065298 (+1357223us) service_pool.cc:224] Handling call
0709 12:27:07.266944 (+201646us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54004150d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:07.269292 (+  2348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254159104}
I20260709 12:27:07.336426  7670 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:07.376340  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 131847us
I20260709 12:27:07.372481  7013 rpcz_store.cc:276] 0709 12:27:05.982675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.371197 (+1388522us) service_pool.cc:224] Handling call
0709 12:27:07.371563 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.371805 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.371830 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.371888 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:07.371932 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.371985 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.372081 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.330526  7739 raft_consensus.cc:2764] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:27:07.378767  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
W20260709 12:27:07.426849  7128 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.430133  7128 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.382222  7951 raft_consensus.cc:3055] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:07.369170  7008 rpcz_store.cc:276] 0709 12:27:05.699873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.254292 (+1554419us) service_pool.cc:224] Handling call
0709 12:27:07.255295 (+  1003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.329109 (+ 73814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.329350 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.382607  7016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 237) took 1399 ms. Trace:
W20260709 12:27:07.348059  7010 rpcz_store.cc:269] 0709 12:27:05.725159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.207601 (+482442us) service_pool.cc:224] Handling call
0709 12:27:06.859570 (+651969us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b58001b0698. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:07.248028 (+388458us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b58001b0698. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efe9c 00007f28750efa5b 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:07.289280 (+ 41252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57024128}
I20260709 12:27:07.383330  7165 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:07.274667  8124 raft_consensus.cc:515] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:07.340108  8080 raft_consensus.cc:2804] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:07.349174  7091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46248 (request call id 175) took 1352 ms. Trace:
I20260709 12:27:07.437605  7091 rpcz_store.cc:276] 0709 12:27:05.991146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.199205 (+1208059us) service_pool.cc:224] Handling call
0709 12:27:07.199568 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.343034 (+143466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.343259 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.435246  7016 rpcz_store.cc:276] 0709 12:27:05.983356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.381715 (+1398359us) service_pool.cc:224] Handling call
0709 12:27:07.382085 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.382294 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.382316 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.382371 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:07.382415 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.382465 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.382558 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.344496  7011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 287) took 1645 ms. Trace:
I20260709 12:27:07.350198  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:07.410662  7164 raft_consensus.cc:2468] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:07.376230  7014 raft_consensus.cc:1240] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:07.418013  8072 raft_consensus.cc:740] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:07.373353  7673 consensus_queue.cc:260] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:07.382089  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 90992.3us
I20260709 12:27:07.440140  7128 leader_election.cc:304] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:07.417729  7009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 239) took 1427 ms. Trace:
I20260709 12:27:07.442519  8080 raft_consensus.cc:697] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:07.426087  8040 raft_consensus.cc:3060] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.443660  7163 raft_consensus.cc:2393] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 2: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:07.425951  7086 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46248 (request call id 186) took 1362 ms. Trace:
I20260709 12:27:07.369921  7007 rpcz_store.cc:276] 0709 12:27:05.957008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.307649 (+1350641us) service_pool.cc:224] Handling call
0709 12:27:07.308227 (+   578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.369124 (+ 60897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.369341 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:07.444589  7130 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.445057  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.444903  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:07.417101  7157 raft_consensus.cc:2468] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:07.446717  7013 raft_consensus.cc:1240] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:07.433451  7951 raft_consensus.cc:740] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:07.443169  6914 catalog_manager.cc:5697] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 1 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:07.452875  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 203083us
I20260709 12:27:07.454417  7164 raft_consensus.cc:2468] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
W20260709 12:27:07.455194  6981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.455767  8080 consensus_queue.cc:237] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:07.456670  7943 raft_consensus.cc:2749] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:07.456845  7673 raft_consensus.cc:3060] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.446975  7010 pending_rounds.cc:85] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6: Aborting all ops after (but not including) 1
I20260709 12:27:07.455866  7054 leader_election.cc:304] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:07.457176  7008 raft_consensus.cc:1240] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:07.459239  7015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 242) took 1293 ms. Trace:
I20260709 12:27:07.459985  7951 consensus_queue.cc:260] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:07.460901  7013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34210 (request call id 127) took 1101 ms. Trace:
W20260709 12:27:07.462206  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.463035  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:07.467240  7013 rpcz_store.cc:276] 0709 12:27:06.357115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.441196 (+1084081us) service_pool.cc:224] Handling call
0709 12:27:07.446522 (+  5326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.457762 (+ 11240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.457961 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.467013  7015 rpcz_store.cc:276] 0709 12:27:06.164915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.428995 (+1264080us) service_pool.cc:224] Handling call
0709 12:27:07.451856 (+ 22861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.457528 (+  5672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.457565 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.457617 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:07.457654 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.457713 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.457807 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.449110  7990 raft_consensus.cc:493] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:07.450392  8009 raft_consensus.cc:2749] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:07.469373  8172 log.cc:927] Time spent T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:27:07.454192  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:07.483690  7084 raft_consensus.cc:2468] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:07.466809  7985 consensus_queue.cc:1048] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:27:07.484833  7008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 298) took 1136 ms. Trace:
I20260709 12:27:07.508795  7008 rpcz_store.cc:276] 0709 12:27:06.348598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.443367 (+1094769us) service_pool.cc:224] Handling call
0709 12:27:07.456981 (+ 13614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.471473 (+ 14492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.484765 (+ 13292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.471828  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:07.512794  7985 consensus_queue.cc:1059] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:07.513136  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:07.514261  7985 raft_consensus.cc:3055] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:07.514741  7985 raft_consensus.cc:740] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:07.470062  7010 pending_rounds.cc:107] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:27:07.516753  7010 raft_consensus.cc:2889] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:07.517001  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 48294.7us
W20260709 12:27:07.518185  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 62432us
I20260709 12:27:07.485657  7990 raft_consensus.cc:515] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:07.519188  7054 leader_election.cc:304] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:07.520651  7990 leader_election.cc:290] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:07.520782  8032 raft_consensus.cc:2749] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:07.485460  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:07.522961  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:07.524628  7088 raft_consensus.cc:1240] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.463641  7903 raft_consensus.cc:2804] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:07.525847  7903 raft_consensus.cc:697] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:07.490584  7013 raft_consensus.cc:1240] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.526786  7054 leader_election.cc:304] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:07.457382  7014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 235) took 1474 ms. Trace:
I20260709 12:27:07.528244  8009 raft_consensus.cc:2749] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:07.529448  7161 raft_consensus.cc:1240] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:07.530818  8135 raft_consensus.cc:515] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:07.515890  7985 consensus_queue.cc:260] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:07.533432  8072 consensus_queue.cc:260] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:07.470518  7012 raft_consensus.cc:1240] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.497428  7951 raft_consensus.cc:3060] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.480027  8124 leader_election.cc:290] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:07.451982  7086 rpcz_store.cc:276] 0709 12:27:06.057857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.200484 (+1142627us) service_pool.cc:224] Handling call
0709 12:27:07.200881 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.201113 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:27:07.265067 (+ 63954us) log.cc:844] Serialized 14 byte log entry
0709 12:27:07.351196 (+ 86129us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.367013 (+ 15817us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:07.377354 (+ 10341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.393639 (+ 16285us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.402715 (+  9076us) spinlock_profiling.cc:243] Waited 8.15 ms on lock 0x7b1800162820. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287dfefab1 00007f287dffc281 00007f2875127522 00007f28751297c1 00007f2875129779 00007f2875129709 00007f28751296d1 00007f28751289cd 0000000000388634 0000000000388479 00007f287510a83a
0709 12:27:07.419942 (+ 17227us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":103897,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":1759,"raft.queue_time_us":5986,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":17307,"spinlock_wait_cycles":18736000,"thread_start_us":137951,"threads_started":2,"wal-append.queue_time_us":92059}
I20260709 12:27:07.440805  7011 rpcz_store.cc:276] 0709 12:27:05.699152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.252842 (+1553690us) service_pool.cc:224] Handling call
0709 12:27:07.253226 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.320914 (+ 67688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.341048 (+ 20134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.500331  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:07.530546  6914 catalog_manager.cc:5697] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 1 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:07.495268  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:07.532688  7204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.530436  7054 leader_election.cc:304] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:07.526948  7903 consensus_queue.cc:237] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:07.542876  7165 raft_consensus.cc:2468] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 4.
I20260709 12:27:07.449245  7009 rpcz_store.cc:276] 0709 12:27:05.983809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.403654 (+1419845us) service_pool.cc:224] Handling call
0709 12:27:07.404015 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.404276 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.404304 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.404360 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:07.404393 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.404463 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.411470 (+  7007us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:07.546557  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 109723us
I20260709 12:27:07.528066  7014 rpcz_store.cc:276] 0709 12:27:05.982898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.371963 (+1389065us) service_pool.cc:224] Handling call
0709 12:27:07.372339 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.448109 (+ 75770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.457301 (+  9192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.521493  7990 raft_consensus.cc:2749] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:07.546352  7084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46248 (request call id 187) took 1098 ms. Trace:
I20260709 12:27:07.519912  8040 raft_consensus.cc:515] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:07.564875  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 92770us
I20260709 12:27:07.568022  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:07.569111  7239 raft_consensus.cc:2468] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:07.563359  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:07.570173  7157 raft_consensus.cc:1275] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:07.569819  8140 raft_consensus.cc:515] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:07.570629  8007 consensus_queue.cc:1059] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:07.571060  7885 consensus_queue.cc:1059] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:07.571640  7088 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 215) took 3099 ms. Trace:
I20260709 12:27:07.572446  7009 raft_consensus.cc:1275] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:07.573040  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:07.572237  8007 raft_consensus.cc:3055] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:07.573822  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:07.575887  8007 raft_consensus.cc:740] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:07.572052  7088 rpcz_store.cc:276] 0709 12:27:04.471746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.163206 (+2691460us) service_pool.cc:224] Handling call
0709 12:27:07.524309 (+361103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.524973 (+   664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.571457 (+ 46484us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b5400202bd0. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782138ad 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:07.571586 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829459200}
I20260709 12:27:07.576717  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:07.573257  7885 raft_consensus.cc:3055] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:07.577399  7885 raft_consensus.cc:740] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:07.571094  7234 raft_consensus.cc:1240] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:07.580668  7012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 240) took 1557 ms. Trace:
I20260709 12:27:07.581669  8135 leader_election.cc:290] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:07.581436  8007 consensus_queue.cc:260] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:07.580654  8140 leader_election.cc:290] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:07.581979  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:07.582844  8007 raft_consensus.cc:3060] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.572955  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:07.583372  7202 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:07.583971  7236 raft_consensus.cc:2393] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 1: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:07.584162  7739 consensus_queue.cc:1059] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:07.551765  7985 raft_consensus.cc:3060] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.585736  7205 leader_election.cc:304] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:07.568014  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:07.558807  7087 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 228) took 1324 ms. Trace:
I20260709 12:27:07.561604  8072 raft_consensus.cc:3060] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:07.594020  7129 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.605017  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 74740.2us
W20260709 12:27:07.614114  7130 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.589841  8124 raft_consensus.cc:2749] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:07.630239  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:07.631317  7157 raft_consensus.cc:2468] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:07.626466  8009 raft_consensus.cc:493] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:07.635638  8009 raft_consensus.cc:515] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:07.636658  8179 raft_consensus.cc:3055] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:07.637128  8179 raft_consensus.cc:740] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:07.637416  6910 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48294 (request call id 60) took 9195 ms. Trace:
I20260709 12:27:07.630604  7156 raft_consensus.cc:1240] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:07.581204  7012 rpcz_store.cc:276] 0709 12:27:06.023507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.425645 (+1402138us) service_pool.cc:224] Handling call
0709 12:27:07.454648 (+ 29003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.552628 (+ 97980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.565564 (+ 12936us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.625590  7054 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:07.624497  7203 leader_election.cc:304] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:07.594050  7230 raft_consensus.cc:2468] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:07.627925  7055 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:07.642526  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 59226.5us
I20260709 12:27:07.596498  7670 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:07.648723  7930 consensus_queue.cc:1059] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:07.652683  8133 consensus_queue.cc:1059] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:07.653982  8084 consensus_queue.cc:1059] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:07.646328  7161 raft_consensus.cc:1240] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260709 12:27:07.562590  7084 rpcz_store.cc:276] 0709 12:27:06.448276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.031603 (+583327us) service_pool.cc:224] Handling call
0709 12:27:07.545733 (+514130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.598618  8140 raft_consensus.cc:3060] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:07.632439  6914 catalog_manager.cc:5697] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b reported cstate change: term changed from 1 to 2, leader changed from 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65) to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 2 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:07.665135  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 101952us
I20260709 12:27:07.671237  7163 raft_consensus.cc:2468] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:07.638667  8009 leader_election.cc:290] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:07.675518  6980 leader_election.cc:304] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:07.638195  8179 consensus_queue.cc:260] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:07.677116  7930 raft_consensus.cc:3055] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:07.677861  8133 consensus_queue.cc:1243] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer e6a8a26eb5294e4cb87412a7f2698f41 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:27:07.678668  7650 raft_consensus.cc:3055] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:07.591801  7885 consensus_queue.cc:260] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:07.680060  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 58281.8us
I20260709 12:27:07.680742  8124 raft_consensus.cc:2749] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:07.683596  8040 leader_election.cc:290] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:07.661098  8106 consensus_queue.cc:1059] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:27:07.685113  7233 raft_consensus.cc:3055] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:07.686151  7670 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:07.686508  7160 raft_consensus.cc:2468] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:07.687000  7232 raft_consensus.cc:1240] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:27:07.642179  7739 raft_consensus.cc:2749] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:27:07.690655  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 70651.9us
I20260709 12:27:07.701705  7203 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:07.691716  7673 raft_consensus.cc:2804] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:07.734778  7055 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:07.736809  8124 raft_consensus.cc:2749] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:07.738027  7234 raft_consensus.cc:1240] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.705430  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:07.702064  8141 raft_consensus.cc:3055] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:07.739450  6914 catalog_manager.cc:5697] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 1 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:07.741195  7159 raft_consensus.cc:2468] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:07.742697  8133 consensus_queue.cc:1059] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:07.736316  7055 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:07.742192  8007 raft_consensus.cc:493] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
W20260709 12:27:07.747221  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 121735us
I20260709 12:27:07.694191  7930 raft_consensus.cc:740] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:07.697283  7971 raft_consensus.cc:2804] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:07.698113  8009 raft_consensus.cc:2749] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:07.699517  7007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34210 (request call id 129) took 1340 ms. Trace:
I20260709 12:27:07.695600  7650 raft_consensus.cc:740] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:07.702667  8179 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:07.700385  7233 raft_consensus.cc:740] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:07.750650  7670 consensus_queue.cc:1059] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:27:07.702312  8084 raft_consensus.cc:3055] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:07.697463  8160 consensus_queue.cc:1059] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:27:07.704258  7885 raft_consensus.cc:3060] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:07.758782  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 57172.6us
I20260709 12:27:07.758550  7054 leader_election.cc:304] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:07.754670  6914 catalog_manager.cc:5697] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b reported cstate change: term changed from 1 to 3, leader changed from e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68) to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 3 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:07.736856  7238 raft_consensus.cc:1275] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:07.753613  7673 raft_consensus.cc:697] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:07.750355  8141 raft_consensus.cc:740] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:07.767592  7055 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:07.751605  8028 raft_consensus.cc:3055] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:07.817229  6980 leader_election.cc:304] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:07.758019  7971 raft_consensus.cc:493] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:07.826867  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 68427.5us
I20260709 12:27:07.761674  7157 raft_consensus.cc:1240] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.761135  8124 raft_consensus.cc:2749] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:07.770514  8140 raft_consensus.cc:2749] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:07.760926  8133 raft_consensus.cc:3055] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:07.774188  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:07.764741  7010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34210 (request call id 128) took 1399 ms. Trace:
I20260709 12:27:07.752699  8080 consensus_queue.cc:1048] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:27:07.752440  8072 consensus_queue.cc:1059] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:27:07.833721  6980 leader_election.cc:304] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:07.637825  6910 rpcz_store.cc:276] 0709 12:26:58.442313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.442478 (+   165us) service_pool.cc:224] Handling call
0709 12:27:07.637157 (+9194679us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:05.414974 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:05.415536 (+   562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:05.415570 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:27:05.415588 (+    18us) tablet.cc:662] Decoding operations
0709 12:27:05.416291 (+   703us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:05.416357 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:05.416383 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:27:05.416950 (+   567us) tablet.cc:701] Row locks acquired
0709 12:27:05.416968 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:27:05.417124 (+   156us) write_op.cc:270] Start()
0709 12:27:05.417233 (+   109us) write_op.cc:276] Timestamp: P: 1783600025417083 usec, L: 0
0709 12:27:05.417253 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:27:05.417896 (+   643us) log.cc:844] Serialized 2078 byte log entry
0709 12:27:05.723981 (+306085us) op_driver.cc:464] REPLICATION: finished
0709 12:27:05.934881 (+210900us) write_op.cc:301] APPLY: starting
0709 12:27:05.940742 (+  5861us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:05.965330 (+ 24588us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:06.019941 (+ 54611us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:06.170180 (+150239us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:06.201514 (+ 31334us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:27:06.212260 (+ 10746us) write_op.cc:312] APPLY: finished
0709 12:27:06.264792 (+ 52532us) log.cc:844] Serialized 46 byte log entry
0709 12:27:06.281958 (+ 17166us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:06.287964 (+  6006us) write_op.cc:454] Released schema lock
0709 12:27:06.294038 (+  6074us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:06.329444 (+ 35406us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:06.331298 (+  1854us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1750050,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":151419,"apply.run_cpu_time_us":4471,"apply.run_wall_time_us":404045,"num_ops":5,"prepare.queue_time_us":111015,"prepare.run_cpu_time_us":24068,"prepare.run_wall_time_us":129891,"raft.queue_time_us":55826,"raft.run_cpu_time_us":9535,"raft.run_wall_time_us":164435,"replication_time_us":295347,"thread_start_us":282200,"threads_started":4,"wal-append.queue_time_us":175885,"wal-append.run_cpu_time_us":5766,"wal-append.run_wall_time_us":1723851}]]}
I20260709 12:27:07.794667  8084 raft_consensus.cc:740] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:07.824759  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:07.775271  8036 consensus_queue.cc:1059] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:27:07.772344  8178 consensus_queue.cc:1048] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:27:07.807215  8028 raft_consensus.cc:740] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:07.819043  8040 raft_consensus.cc:2804] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:07.775038  8017 consensus_queue.cc:1059] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:27:07.793182  8007 raft_consensus.cc:515] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:07.852890  7650 consensus_queue.cc:260] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:07.820843  8058 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:07.854339  7650 raft_consensus.cc:3060] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:07.766028  7930 consensus_queue.cc:260] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:07.855340  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:07.855554  7930 raft_consensus.cc:3060] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:07.836719  8135 raft_consensus.cc:2749] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:07.849900  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 77602.8us
I20260709 12:27:07.850310  6914 catalog_manager.cc:5697] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b reported cstate change: term changed from 1 to 2, leader changed from 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66) to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 2 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:07.856882  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 89418.9us
I20260709 12:27:07.774144  8150 consensus_queue.cc:1059] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:27:07.858107  6980 leader_election.cc:304] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:07.835947  7971 raft_consensus.cc:3060] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:07.800845  8164 consensus_queue.cc:1059] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:27:07.597376  7087 rpcz_store.cc:276] 0709 12:27:06.227805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.205889 (+978084us) service_pool.cc:224] Handling call
0709 12:27:07.206362 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:07.206911 (+   549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.206945 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:07.245271 (+ 38326us) log.cc:844] Serialized 26 byte log entry
0709 12:27:07.436902 (+191631us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:07.458154 (+ 21252us) log.cc:844] Serialized 14 byte log entry
0709 12:27:07.470701 (+ 12547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.477225 (+  6524us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.541323 (+ 64098us) raft_consensus.cc:1685] finished
0709 12:27:07.545420 (+  4097us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.549101 (+  3681us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47801,"prepare.queue_time_us":13123,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":1570,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":2559,"thread_start_us":104969,"threads_started":1,"wal-append.queue_time_us":206830}
W20260709 12:27:07.873981  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 67586.9us
I20260709 12:27:07.824587  7739 consensus_queue.cc:1059] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:27:07.838591  8133 raft_consensus.cc:740] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:07.847728  7012 raft_consensus.cc:1275] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:07.875288  7203 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:07.838704  7981 raft_consensus.cc:2804] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:07.848078  8009 raft_consensus.cc:2749] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:27:07.874744  7926 consensus_meta.cc:287] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.002s
W20260709 12:27:07.870515  8111 consensus_meta.cc:287] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.000s
W20260709 12:27:07.897311  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 108011us
W20260709 12:27:07.900843  7130 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.861755  8144 raft_consensus.cc:2749] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:07.854360  8058 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:07.869581  7670 consensus_queue.cc:1059] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:27:07.917743  7055 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:07.918525  8194 raft_consensus.cc:493] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:07.927049  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.914997  8017 raft_consensus.cc:3055] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:07.937631  8017 raft_consensus.cc:740] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:07.937721  7232 raft_consensus.cc:1240] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:07.938328  7087 raft_consensus.cc:1240] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:07.938565  8017 consensus_queue.cc:260] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:07.790190  7007 rpcz_store.cc:276] 0709 12:27:06.357675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.459497 (+1101822us) service_pool.cc:224] Handling call
0709 12:27:07.459899 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:07.460155 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.460186 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:07.460663 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:27:07.622691 (+162028us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:27:07.629053 (+  6362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.643599 (+ 14546us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.691120 (+ 47521us) raft_consensus.cc:1685] finished
0709 12:27:07.691134 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.698143 (+  7009us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":131558,"threads_started":1,"wal-append.queue_time_us":203286}
I20260709 12:27:07.940274  8017 raft_consensus.cc:3060] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:07.920769  7162 raft_consensus.cc:2468] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
W20260709 12:27:07.948726  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.872843  7673 consensus_queue.cc:237] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:07.917413  8187 raft_consensus.cc:2804] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:27:07.957805  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 82607.4us
I20260709 12:27:07.959168  7203 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:07.864636  8141 consensus_queue.cc:260] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:07.901510  8135 consensus_queue.cc:1059] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 12:27:07.971382  7130 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.917416  7158 raft_consensus.cc:2468] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:07.955178  8020 raft_consensus.cc:493] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.966918  8072 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:07.966640  8157 raft_consensus.cc:3055] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:07.972631  8124 raft_consensus.cc:2804] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:07.977015  8196 consensus_queue.cc:1048] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:08.017680  7204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.983052  7971 raft_consensus.cc:515] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:07.985836  8058 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:07.989728  8009 raft_consensus.cc:3055] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:07.990038  8007 leader_election.cc:290] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:07.990717  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 71786.7us
I20260709 12:27:07.956077  8133 consensus_queue.cc:260] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:07.991287  8150 consensus_queue.cc:1059] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:07.991683  8141 raft_consensus.cc:3060] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:07.992321  8192 raft_consensus.cc:3055] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:08.040369  8192 raft_consensus.cc:740] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:08.041774  8192 consensus_queue.cc:260] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:08.043807  8192 raft_consensus.cc:3060] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.992763  7739 raft_consensus.cc:2804] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:07.992673  7233 consensus_queue.cc:260] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:08.044790  7739 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.045217  7739 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:08.045274  7233 raft_consensus.cc:3060] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:07.993737  8040 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.048902  8040 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:07.996129  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:08.053601  8150 raft_consensus.cc:3055] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:08.053965  7090 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 5.
I20260709 12:27:08.054301  8150 raft_consensus.cc:740] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:08.055014  8017 consensus_queue.cc:1059] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:07.996440  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:08.024524  7650 consensus_queue.cc:1059] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:27:08.056366  7083 raft_consensus.cc:2393] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 2: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:08.059077  8178 raft_consensus.cc:3055] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:08.059458  8178 raft_consensus.cc:740] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:08.060345  8178 consensus_queue.cc:260] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:07.996937  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:07.997165  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:07.997396  7089 raft_consensus.cc:1240] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:08.061725  8178 raft_consensus.cc:3060] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.998596  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:07.997781  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:27:08.007776  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 93605.8us
W20260709 12:27:08.016144  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 170430us
I20260709 12:27:08.063330  6980 leader_election.cc:304] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:07.970089  8187 raft_consensus.cc:493] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:07.916769  8084 consensus_queue.cc:260] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:08.014249  8124 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.839579  7010 rpcz_store.cc:276] 0709 12:27:06.357397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.444293 (+1086896us) service_pool.cc:224] Handling call
0709 12:27:07.446733 (+  2440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:07.517451 (+ 70718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.517497 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:07.518005 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 12:27:07.695172 (+177167us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:07.696871 (+  1699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.701478 (+  4607us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.745220 (+ 43742us) raft_consensus.cc:1685] finished
0709 12:27:07.747737 (+  2517us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.754244 (+  6507us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":154088,"threads_started":1,"wal-append.queue_time_us":182984}
I20260709 12:27:08.007164  8157 raft_consensus.cc:740] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
W20260709 12:27:08.039377  6982 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.024917  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:08.032994  8009 raft_consensus.cc:740] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:08.039364  8197 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:08.061861  7084 raft_consensus.cc:2393] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 2: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:08.020339  8020 raft_consensus.cc:515] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:07.933183  8028 consensus_queue.cc:260] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:08.065250  7088 raft_consensus.cc:3060] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:08.065979  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 148692us
I20260709 12:27:08.066237  7091 raft_consensus.cc:2468] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:08.022529  7981 raft_consensus.cc:697] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:07.951146  8194 raft_consensus.cc:515] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:08.093621  7202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:08.093909  7128 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.079833  7055 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
W20260709 12:27:08.094415  7128 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.995849  7203 leader_election.cc:304] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:08.055646  8150 consensus_queue.cc:260] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:08.094776  8135 raft_consensus.cc:2804] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:08.093761  8197 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:08.078495  8124 raft_consensus.cc:3060] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:08.097259  7128 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.092685  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:08.087687  8106 raft_consensus.cc:2749] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:27:08.101809  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 106049us
I20260709 12:27:08.104533  7203 leader_election.cc:304] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:08.072847  8187 raft_consensus.cc:3060] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.105762  6980 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:08.102748  7985 consensus_queue.cc:1059] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
W20260709 12:27:08.108752  8191 log.cc:927] Time spent T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:27:08.107908  8205 raft_consensus.cc:2804] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:08.109601  8144 consensus_queue.cc:1048] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:08.111362  8144 raft_consensus.cc:2804] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:08.111928  8144 raft_consensus.cc:697] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:08.112931  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:08.113747  7086 raft_consensus.cc:3060] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.092525  7670 raft_consensus.cc:493] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:08.095286  8135 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.098958  7082 raft_consensus.cc:1240] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
W20260709 12:27:08.062671  8036 consensus_queue.cc:1175] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "022925662268440c91fff7e8732d7a0b" responder_term: 3 status { last_received { term: 3 index: 3 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:08.129043  8157 consensus_queue.cc:260] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:08.133435  7673 raft_consensus.cc:2804] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:08.133936  7673 raft_consensus.cc:697] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:08.133992  8144 consensus_queue.cc:237] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:08.134873  7673 consensus_queue.cc:237] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:08.135789  8028 raft_consensus.cc:3060] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.100973  8150 raft_consensus.cc:3060] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.136996  7162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56794 (request call id 220) took 1099 ms. Trace:
I20260709 12:27:08.137465  7162 rpcz_store.cc:276] 0709 12:27:07.037802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.066838 (+ 29036us) service_pool.cc:224] Handling call
0709 12:27:08.136787 (+1069949us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b540082c654. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:08.136922 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1861263616}
I20260709 12:27:08.138134  7010 raft_consensus.cc:1275] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:08.138634  8157 raft_consensus.cc:3060] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.139345  8195 raft_consensus.cc:3055] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:08.139766  8195 raft_consensus.cc:740] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
W20260709 12:27:08.182909  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 73637.9us
I20260709 12:27:08.184633  6980 leader_election.cc:304] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:08.186703  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:08.123006  8135 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:08.127905  7981 consensus_queue.cc:237] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:08.211222  7130 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.185621  8205 raft_consensus.cc:697] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:08.219862  8160 raft_consensus.cc:3055] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:08.220492  8160 raft_consensus.cc:740] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:08.220413  8205 consensus_queue.cc:237] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:08.187569  7089 raft_consensus.cc:2376] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 4. Re-sending same reply.
I20260709 12:27:08.140722  8195 consensus_queue.cc:260] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:08.229935  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 121014us
I20260709 12:27:08.225322  6980 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:08.224174  8133 raft_consensus.cc:3060] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:08.233460  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:08.224277  8205 raft_consensus.cc:493] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.234265  7158 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:08.235376  8205 raft_consensus.cc:515] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:08.236337  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:08.236863  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:08.237778  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:08.243397  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 322890us
W20260709 12:27:08.245471  7129 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.237804  8205 leader_election.cc:290] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:08.246433  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:08.248497  7203 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:08.186077  7930 consensus_queue.cc:1048] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:27:08.249960  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:08.192137  7739 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:08.247815  7239 raft_consensus.cc:2393] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 5: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:08.189121  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:08.122910  7670 raft_consensus.cc:515] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:08.255338  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 160443us
I20260709 12:27:08.157889  8106 consensus_queue.cc:1048] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
W20260709 12:27:08.260329  7129 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.264850  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:08.265604  7164 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:08.267131  8197 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:08.268863  8195 raft_consensus.cc:3060] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.268996  8201 raft_consensus.cc:2804] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:27:08.271806  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.227051  8140 raft_consensus.cc:3055] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:08.287501  8144 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.294235  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:08.252739  7739 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:08.298588  7164 raft_consensus.cc:2468] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:27:08.300107  7203 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:08.288213  8144 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:08.304522  6979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.191882  8193 consensus_queue.cc:1059] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:27:08.307644  7239 raft_consensus.cc:1275] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:08.268877  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:08.308158  7088 raft_consensus.cc:2468] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:08.188853  8009 consensus_queue.cc:260] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:08.320662  7990 consensus_queue.cc:1048] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:08.310153  7236 raft_consensus.cc:2468] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:27:08.291302  8140 raft_consensus.cc:740] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:08.310664  7087 raft_consensus.cc:2393] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 4: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
W20260709 12:27:08.345297  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 45321.5us
I20260709 12:27:08.315459  7943 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.352059  8214 raft_consensus.cc:2804] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:08.350428  7238 raft_consensus.cc:1240] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:08.349751  7739 raft_consensus.cc:2804] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:08.350085  8213 raft_consensus.cc:2804] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:08.355247  8214 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:08.374339  8084 raft_consensus.cc:3060] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.386488  7239 raft_consensus.cc:1275] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:27:08.389285  7130 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.373268  8009 raft_consensus.cc:3060] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:08.389935  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 98949.7us
I20260709 12:27:08.385386  8201 raft_consensus.cc:697] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:08.387841  8020 leader_election.cc:290] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:08.417397  8209 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.384829  7739 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:08.418938  7739 raft_consensus.cc:3060] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:08.418862  8209 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:08.396034  8221 consensus_queue.cc:1048] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:27:08.421466  8209 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:08.401608  8213 raft_consensus.cc:697] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:08.422735  8213 consensus_queue.cc:237] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:08.395248  8214 raft_consensus.cc:3060] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.399312  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:08.362443  7943 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:08.397568  7055 leader_election.cc:304] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
W20260709 12:27:08.439833  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:08.457518  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 61602.7us
I20260709 12:27:08.429803  8144 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:08.390785  8194 leader_election.cc:290] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:08.471766  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:08.472600  7089 raft_consensus.cc:2393] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 3: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:08.475083  7088 raft_consensus.cc:1240] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:08.426105  8040 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:08.506883  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:27:08.511113  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.515079  7089 raft_consensus.cc:1240] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:27:08.517742  8218 log.cc:927] Time spent T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:27:08.522519  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:08.523218  7088 raft_consensus.cc:2468] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:27:08.522367  7158 raft_consensus.cc:2410] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:08.524770  8208 raft_consensus.cc:2804] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:08.525312  8208 raft_consensus.cc:697] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:08.526234  8208 consensus_queue.cc:237] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:08.528818  7233 raft_consensus.cc:1275] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:27:08.529383  8220 log.cc:927] Time spent T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 12:27:08.530951  8203 log.cc:927] Time spent T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:27:08.532500  7232 raft_consensus.cc:1275] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:08.519264  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:08.538576  8135 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:08.511143  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:08.549607  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:08.567371  7016 raft_consensus.cc:2468] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:08.541906  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:08.552027  7055 leader_election.cc:304] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:08.568133  7130 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.569563  7128 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:08.568583  7015 raft_consensus.cc:2468] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:08.545871  7082 raft_consensus.cc:2393] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 4: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:08.597271  7205 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:08.546952  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:08.600243  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:08.541858  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:08.573783  8201 consensus_queue.cc:237] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:08.578611  8196 raft_consensus.cc:2804] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:08.602393  7128 leader_election.cc:304] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:08.542464  7008 raft_consensus.cc:1240] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:08.601222  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
W20260709 12:27:08.605209  7202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.605406  7164 raft_consensus.cc:1275] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:08.600534  7237 raft_consensus.cc:1240] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:08.545159  7943 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:08.544036  8135 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:08.606871  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:08.606712  7089 raft_consensus.cc:1275] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:08.545223  7086 raft_consensus.cc:2468] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:08.573417  8141 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.601135  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:08.615100  8196 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.616277  7205 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:08.540530  7739 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:08.620303  7128 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.623215  8198 raft_consensus.cc:2804] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:08.612864  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
W20260709 12:27:08.574827  8072 consensus_meta.cc:287] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.001s
W20260709 12:27:08.617604  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 268437us
W20260709 12:27:08.638185  8178 consensus_meta.cc:287] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.576s	user 0.012s	sys 0.000s
I20260709 12:27:08.618408  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:08.621308  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:08.678751  7128 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:08.660120  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.630721  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
W20260709 12:27:08.685789  7128 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.649307  8196 raft_consensus.cc:3060] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:08.662256  8157 raft_consensus.cc:2749] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:27:08.685266  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 133348us
I20260709 12:27:08.687588  7161 raft_consensus.cc:2393] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 4: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:08.698292  7088 raft_consensus.cc:1240] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:08.648005  8226 raft_consensus.cc:2804] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:08.662084  8072 raft_consensus.cc:2749] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:08.647405  8141 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:08.683867  8223 raft_consensus.cc:493] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.652534  8198 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.717280  7205 leader_election.cc:304] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:08.655452  7951 consensus_queue.cc:1059] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:27:08.720371  7088 raft_consensus.cc:1240] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:08.694929  7157 raft_consensus.cc:2468] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:08.715997  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:08.700505  8226 raft_consensus.cc:493] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:08.711993  8215 raft_consensus.cc:2749] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:08.726073  8222 consensus_queue.cc:1048] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:27:08.733193  8194 consensus_queue.cc:1048] T 1f0c1fabae4b45f5a06cac8289e281ab P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:08.708596  8198 raft_consensus.cc:3060] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:08.731817  8226 raft_consensus.cc:3060] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.739375  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:27:08.723907  8219 log.cc:927] Time spent T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:27:08.740998  7090 raft_consensus.cc:1240] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:08.747663  7088 raft_consensus.cc:2393] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 4: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:08.747365  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:08.731287  7943 consensus_queue.cc:1048] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:27:08.753436  7739 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:08.756338  7082 raft_consensus.cc:1240] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:08.757632  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:08.758301  7085 raft_consensus.cc:3060] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.765343  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:08.767616  7943 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.768304  7943 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:08.723263  8040 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:08.725030  8036 raft_consensus.cc:2804] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:08.708106  8020 consensus_queue.cc:1059] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:27:08.748656  7089 raft_consensus.cc:2393] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 2: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:08.772691  8241 raft_consensus.cc:493] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:08.783043  7943 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:08.783440  8241 raft_consensus.cc:515] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:08.785712  8241 leader_election.cc:290] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:08.775372  7739 raft_consensus.cc:493] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:08.786545  7739 raft_consensus.cc:515] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:08.788720  7739 leader_election.cc:290] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:27:08.768479  8124 consensus_meta.cc:287] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.662s	user 0.005s	sys 0.004s
I20260709 12:27:08.801380  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:08.714411  8223 raft_consensus.cc:515] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:08.725361  8211 consensus_queue.cc:1048] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
W20260709 12:27:08.777575  8236 log.cc:927] Time spent T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 12:27:08.772118  8187 consensus_meta.cc:287] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.000s
I20260709 12:27:08.824355  7089 raft_consensus.cc:2468] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:27:08.778069  8036 raft_consensus.cc:493] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.815912  8222 raft_consensus.cc:3055] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:08.842332  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:27:08.827230  8150 consensus_meta.cc:287] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.690s	user 0.004s	sys 0.007s
I20260709 12:27:08.772619  8237 consensus_queue.cc:1048] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
W20260709 12:27:08.849470  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 47626.2us
W20260709 12:27:08.838824  8192 consensus_meta.cc:287] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.794s	user 0.010s	sys 0.005s
I20260709 12:27:08.838537  8036 raft_consensus.cc:3060] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:08.823499  8214 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:08.857061  8141 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:08.843827  8222 raft_consensus.cc:740] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:08.822641  8124 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:08.858511  8133 consensus_meta.cc:287] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 0.626s	user 0.014s	sys 0.002s
W20260709 12:27:08.858850  8234 log.cc:927] Time spent T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:27:08.858981  7156 raft_consensus.cc:1240] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:08.859081  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:08.839658  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:08.827885  8187 raft_consensus.cc:515] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:08.877290  8239 log.cc:927] Time spent T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:27:08.876359  7131 leader_election.cc:304] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:08.875600  7089 raft_consensus.cc:2468] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:27:08.872566  8226 raft_consensus.cc:515] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:08.892318  7085 raft_consensus.cc:2468] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:08.894807  8160 consensus_queue.cc:260] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:08.895977  8160 raft_consensus.cc:3060] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.874456  7162 raft_consensus.cc:1275] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:08.902374  7131 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:08.904791  7131 leader_election.cc:304] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:08.911499  7131 leader_election.cc:304] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:08.912657  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:08.914054  7131 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:08.917886  8195 raft_consensus.cc:2804] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:08.918324  8195 raft_consensus.cc:493] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:08.918558  8214 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:08.918694  8195 raft_consensus.cc:3060] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.919818  8223 leader_election.cc:290] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:08.916738  7943 raft_consensus.cc:2749] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:27:08.921450  7055 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.921681  8124 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:08.925258  7131 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:08.905678  8084 raft_consensus.cc:2749] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:08.928243  8140 consensus_queue.cc:260] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:08.929540  8140 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:08.922313  8133 raft_consensus.cc:2749] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:08.931730  8187 leader_election.cc:290] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:08.932612  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:08.933681  7085 raft_consensus.cc:2393] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 2: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:08.935520  8036 raft_consensus.cc:515] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:08.936340  7055 leader_election.cc:304] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:08.937891  8020 raft_consensus.cc:2764] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:27:08.938704  8020 consensus_queue.cc:1059] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:08.940785  8036 leader_election.cc:290] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:08.926920  7943 raft_consensus.cc:2749] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:08.950511  7131 leader_election.cc:304] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:08.961988  7091 raft_consensus.cc:1240] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:27:08.966563  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:08.967532  7156 raft_consensus.cc:2393] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 2: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:08.955042  8194 raft_consensus.cc:2804] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:08.955574  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:08.961397  8133 raft_consensus.cc:493] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.997274  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:08.999226  7091 raft_consensus.cc:2468] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:08.972450  7943 raft_consensus.cc:2749] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:08.973096  8157 consensus_queue.cc:1059] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:27:09.001360  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:09.005326  8196 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.006558  7164 raft_consensus.cc:1240] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:09.002305  8198 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:09.008886  8157 raft_consensus.cc:3055] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:09.009289  8157 raft_consensus.cc:740] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:09.009476  8196 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.010478  8198 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:09.010159  8157 consensus_queue.cc:260] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:09.012310  8157 raft_consensus.cc:3060] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.000180  8133 raft_consensus.cc:515] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.016753  8133 leader_election.cc:290] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.017423  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:09.020881  7087 raft_consensus.cc:2376] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2. Re-sending same reply.
I20260709 12:27:09.021572  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:09.021973  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:09.020125  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:09.022830  7090 raft_consensus.cc:2468] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:09.023679  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:09.024606  7090 raft_consensus.cc:2393] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 2: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:09.025580  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:09.026490  7090 raft_consensus.cc:2393] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 5: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:09.018374  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:09.027617  7091 raft_consensus.cc:3060] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.031968  8198 raft_consensus.cc:493] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:09.032574  8198 raft_consensus.cc:515] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:09.035382  8217 log.cc:927] Time spent T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.685s	user 0.006s	sys 0.008s
I20260709 12:27:09.035636  8198 leader_election.cc:290] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.031620  8222 consensus_queue.cc:260] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:09.038729  7971 leader_election.cc:290] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:09.039179  8222 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.050843  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:09.053308  7086 raft_consensus.cc:1275] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:09.053463  8199 raft_consensus.cc:3055] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:09.053951  8199 raft_consensus.cc:740] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:09.054772  8199 consensus_queue.cc:260] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:09.055701  8199 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:09.058147  8229 log.cc:927] Time spent T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
I20260709 12:27:09.048202  8195 raft_consensus.cc:515] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:09.063865  7131 leader_election.cc:304] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:09.067874  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:09.068126  8195 leader_election.cc:290] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:09.074633  7670 leader_election.cc:290] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:09.077950  7670 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.078534  7670 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.081135  7670 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.083668  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:09.085007  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:09.086232  8252 raft_consensus.cc:493] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:09.087013  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:09.087152  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:09.088049  7086 raft_consensus.cc:2393] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 4: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:09.090381  7086 raft_consensus.cc:3060] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.086889  8252 raft_consensus.cc:515] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.101058  7091 raft_consensus.cc:2468] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:09.099727  7090 raft_consensus.cc:3060] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.101961  7131 leader_election.cc:304] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:09.107857  7131 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:09.123847  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:09.099684  8198 raft_consensus.cc:2804] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.103464  8195 raft_consensus.cc:493] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.126899  8133 raft_consensus.cc:2804] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:09.136911  8253 raft_consensus.cc:3060] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.142299  8252 leader_election.cc:290] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.147706  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:09.148415  7091 raft_consensus.cc:3060] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.121095  8194 raft_consensus.cc:697] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:09.151885  7090 raft_consensus.cc:2468] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 5.
I20260709 12:27:09.145293  8133 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.140480  8195 raft_consensus.cc:515] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.160179  8195 leader_election.cc:290] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.167994  7091 raft_consensus.cc:2468] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:09.140265  8196 consensus_queue.cc:1048] T 2918b8da0cae441dae40ec77664c668c P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:27:09.169700  7131 leader_election.cc:304] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:09.172421  8196 raft_consensus.cc:2804] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.172945  8196 raft_consensus.cc:697] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:09.173794  8196 consensus_queue.cc:237] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:09.173987  8194 consensus_queue.cc:237] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:09.170686  7087 raft_consensus.cc:2468] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 4.
I20260709 12:27:09.163162  8133 raft_consensus.cc:3060] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:09.179859  8213 raft_consensus.cc:493] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.180485  8213 raft_consensus.cc:515] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.181774  7670 raft_consensus.cc:493] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.182308  7670 raft_consensus.cc:515] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:09.183300  8213 leader_election.cc:290] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.187250  8254 consensus_queue.cc:1059] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:09.191946  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:09.192937  7011 raft_consensus.cc:3060] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:09.188572  7670 leader_election.cc:290] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:09.196003  7086 raft_consensus.cc:1275] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:09.206425  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:09.207474  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:09.206897  8198 raft_consensus.cc:697] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:09.209933  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:09.210465  7230 raft_consensus.cc:1240] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:09.210682  8198 consensus_queue.cc:237] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:09.217186  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:09.217928  7016 raft_consensus.cc:2468] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
W20260709 12:27:09.235431  7202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:09.237049  6981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.237049  8210 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.237807  8210 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.238423  8144 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:09.238952  8144 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.240010  8210 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:09.241039  8144 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:27:09.241683  7202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:09.246999  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 59425us
I20260709 12:27:09.250355  7128 leader_election.cc:304] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:09.251312  8253 raft_consensus.cc:2749] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:09.250928  8133 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:09.262156  8254 raft_consensus.cc:2804] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:09.280033  7236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49174 (request call id 234) took 1034 ms. Trace:
I20260709 12:27:09.280520  7236 rpcz_store.cc:276] 0709 12:27:08.245347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.248092 (+  2745us) service_pool.cc:224] Handling call
0709 12:27:09.279829 (+1031737us) spinlock_profiling.cc:243] Waited 56.1 ms on lock 0x7b54003ebf54. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:09.279968 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129079680}
I20260709 12:27:09.276150  8215 raft_consensus.cc:493] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:09.282125  8215 raft_consensus.cc:515] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.285392  8215 leader_election.cc:290] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:09.276157  8254 raft_consensus.cc:493] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:09.288954  8240 log.cc:927] Time spent T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.554s	user 0.004s	sys 0.002s
I20260709 12:27:09.288892  8254 raft_consensus.cc:3060] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:09.291293  8251 log.cc:927] Time spent T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 12:27:09.315743  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:09.304078  8261 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:09.323164  6982 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.324577  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:09.326314  8261 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.328013  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:09.329322  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:27:09.323774  6982 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.200.66:36713 timed out after 2.219s (SENT) [suppressed 44 similar messages]
I20260709 12:27:09.333659  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:09.335592  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:09.336630  7091 raft_consensus.cc:2468] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:09.337577  7202 leader_election.cc:304] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:09.338155  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:09.338804  7202 leader_election.cc:304] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:09.338825  7016 raft_consensus.cc:3060] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.352908  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:09.340250  8215 raft_consensus.cc:493] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.345238  7670 raft_consensus.cc:2749] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:27:09.361181  8260 log.cc:927] Time spent T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:27:09.365419  8133 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:09.366842  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:09.367774  7082 raft_consensus.cc:3060] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:09.370805  8261 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.375229  7011 raft_consensus.cc:2468] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:09.374015  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:09.376684  7128 leader_election.cc:304] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:09.376945  7015 raft_consensus.cc:3060] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:09.378248  8261 raft_consensus.cc:2804] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:09.345777  8178 raft_consensus.cc:2749] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:09.347375  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:09.381521  8135 raft_consensus.cc:493] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.382212  7087 raft_consensus.cc:2393] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 2: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
W20260709 12:27:09.382540  6979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.382277  8135 raft_consensus.cc:515] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.379789  8215 raft_consensus.cc:515] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.384403  8178 raft_consensus.cc:493] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.384912  8178 raft_consensus.cc:515] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.385321  8135 leader_election.cc:290] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.387815  8178 leader_election.cc:290] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:09.389079  8254 raft_consensus.cc:515] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.397465  8226 leader_election.cc:290] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.399701  7015 raft_consensus.cc:2468] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:09.401212  7015 raft_consensus.cc:1275] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:09.401170  7128 leader_election.cc:304] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:09.402470  7015 raft_consensus.cc:1240] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:09.403520  7015 raft_consensus.cc:1240] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:09.404624  7015 raft_consensus.cc:1275] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:27:09.404912  7015 pending_rounds.cc:85] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6: Aborting all ops after (but not including) 0
I20260709 12:27:09.405128  7015 pending_rounds.cc:107] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:27:09.405344  7015 raft_consensus.cc:2889] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:09.410234  8254 leader_election.cc:290] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.415359  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:09.416105  7012 raft_consensus.cc:3060] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.427341  8215 leader_election.cc:290] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.376449  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:09.436414  7011 raft_consensus.cc:2468] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
W20260709 12:27:09.462670  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 138917us
I20260709 12:27:09.461108  8261 raft_consensus.cc:697] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
W20260709 12:27:09.463814  6982 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.462990  7012 raft_consensus.cc:2468] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 5.
I20260709 12:27:09.470903  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:09.469305  8106 raft_consensus.cc:493] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.471858  7015 raft_consensus.cc:2393] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 2: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:09.475286  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:09.476137  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:09.478156  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:09.481128  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:09.478780  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:09.474474  8106 raft_consensus.cc:515] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:09.479128  8261 consensus_queue.cc:237] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:09.498175  8106 leader_election.cc:290] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:09.498703  8106 raft_consensus.cc:493] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:09.499177  8106 raft_consensus.cc:515] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.493691  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:09.501519  7010 raft_consensus.cc:2376] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3. Re-sending same reply.
I20260709 12:27:09.502532  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:09.504227  8106 leader_election.cc:290] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:09.504492  7011 raft_consensus.cc:2468] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:09.495223  7012 raft_consensus.cc:2393] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 2: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:09.513137  7016 raft_consensus.cc:2468] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 5.
I20260709 12:27:09.522747  8106 consensus_queue.cc:1059] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.525197  8106 raft_consensus.cc:3055] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:09.525725  8106 raft_consensus.cc:740] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:09.527220  8106 consensus_queue.cc:260] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.531888  8106 raft_consensus.cc:3060] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:09.538141  7055 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.540264  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:09.543313  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:09.591022  7084 raft_consensus.cc:1240] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:09.591943  7084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 232) took 1125 ms. Trace:
I20260709 12:27:09.592324  7084 rpcz_store.cc:276] 0709 12:27:08.466078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.469836 (+  3758us) service_pool.cc:224] Handling call
0709 12:27:09.590488 (+1120652us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:09.590772 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:09.591620 (+   848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.591875 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10596096}
I20260709 12:27:09.596684  8222 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.597231  8222 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:09.599556  8222 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:09.609340  7055 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:09.612577  8222 raft_consensus.cc:2749] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:27:09.612155  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.614259  7055 leader_election.cc:304] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:09.615027  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:09.615408  7670 raft_consensus.cc:493] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.615972  7008 raft_consensus.cc:2393] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 2: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:09.615995  7670 raft_consensus.cc:515] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:09.618268  7016 raft_consensus.cc:1240] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:09.619194  7670 leader_election.cc:290] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:09.619870  7971 consensus_queue.cc:1048] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:09.621943  8106 consensus_queue.cc:1048] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:09.622892  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.625841  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:09.631516  7670 raft_consensus.cc:493] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.632175  7670 raft_consensus.cc:515] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.629088  6982 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:09.636637  8199 raft_consensus.cc:2804] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:09.637058  8199 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.637117  6982 leader_election.cc:304] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:09.637447  8199 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:09.638566  6982 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:09.638778  8144 raft_consensus.cc:3060] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.639364  8278 raft_consensus.cc:2749] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:09.640175  6982 leader_election.cc:304] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:09.640976  8278 raft_consensus.cc:2804] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:09.641485  8278 raft_consensus.cc:493] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:09.641847  8278 raft_consensus.cc:3060] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:09.642180  6982 leader_election.cc:304] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:09.643276  6982 leader_election.cc:304] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:09.646970  7971 raft_consensus.cc:2749] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:09.647707  7971 raft_consensus.cc:2749] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:09.650892  8278 raft_consensus.cc:515] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:09.637214  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.652480  7239 raft_consensus.cc:2468] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:09.652592  8199 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.653354  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:09.653568  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.654407  7014 raft_consensus.cc:1240] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:09.654826  8199 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:09.659437  7670 leader_election.cc:290] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.659591  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:09.660077  7670 raft_consensus.cc:493] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.660254  7009 raft_consensus.cc:2376] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 5. Re-sending same reply.
I20260709 12:27:09.660847  7009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34216 (request call id 310) took 1235 ms. Trace:
I20260709 12:27:09.660759  7670 raft_consensus.cc:515] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.661229  7009 rpcz_store.cc:276] 0709 12:27:08.425300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.659301 (+1234001us) service_pool.cc:224] Handling call
0709 12:27:09.660790 (+  1489us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:09.662866  8144 raft_consensus.cc:2749] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:09.663866  8135 raft_consensus.cc:2749] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:09.664705  8278 leader_election.cc:290] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:09.665606  7670 leader_election.cc:290] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:27:09.664783  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 50586.2us
I20260709 12:27:09.666216  7670 raft_consensus.cc:493] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.666109  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.666734  7670 raft_consensus.cc:515] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.668963  7670 leader_election.cc:290] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:09.668938  7055 leader_election.cc:304] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:09.670059  8135 raft_consensus.cc:2804] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:09.670589  8135 raft_consensus.cc:493] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.671032  8135 raft_consensus.cc:3060] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:09.676857  7990 raft_consensus.cc:493] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.677621  7990 raft_consensus.cc:515] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.680398  7990 leader_election.cc:290] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.681030  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.681751  7231 raft_consensus.cc:2468] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:09.669878  7670 consensus_queue.cc:1048] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:27:09.683156  7055 leader_election.cc:304] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:09.683600  7670 raft_consensus.cc:493] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.684198  7990 raft_consensus.cc:2804] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:09.687739  7990 raft_consensus.cc:493] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.688297  7990 raft_consensus.cc:3060] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:09.686232  7670 raft_consensus.cc:515] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.694700  7670 leader_election.cc:290] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:09.719722  7670 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.720399  7670 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:09.708039  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 64843.5us
I20260709 12:27:09.724502  7670 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:09.724694  6982 leader_election.cc:304] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:09.684803  8282 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.717692  8157 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:09.725220  7670 raft_consensus.cc:493] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:09.725661  8157 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.725886  7670 raft_consensus.cc:515] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.727475  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.718530  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.721804  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.698349  8135 raft_consensus.cc:515] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.723027  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.730854  7239 raft_consensus.cc:2393] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 2: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:09.731531  8278 consensus_queue.cc:1059] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:09.731770  7230 raft_consensus.cc:2468] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:09.732457  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.733439  8144 raft_consensus.cc:3055] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:09.733695  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:09.733843  8144 raft_consensus.cc:740] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:09.734400  7230 raft_consensus.cc:3060] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:09.734958  8144 consensus_queue.cc:260] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.735481  7670 leader_election.cc:290] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.736009  7670 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.736606  7234 raft_consensus.cc:2468] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:09.736419  7670 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:09.736392  8144 raft_consensus.cc:3060] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.737685  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:09.733933  7231 raft_consensus.cc:2468] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:09.728271  7233 raft_consensus.cc:2468] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
W20260709 12:27:09.740144  7056 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.740429  8157 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:09.740808  8222 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.741283  8222 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:09.741915  7237 raft_consensus.cc:1240] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:27:09.743001  8241 raft_consensus.cc:493] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:09.743321  8222 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:09.743503  8241 raft_consensus.cc:515] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.744925  8280 raft_consensus.cc:2764] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:27:09.745708  8282 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.745712  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:09.738229  7236 raft_consensus.cc:1240] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:27:09.747925  8282 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:09.732517  6982 leader_election.cc:304] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:09.750413  8241 leader_election.cc:290] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.750797  8210 raft_consensus.cc:2804] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.751080  8241 consensus_queue.cc:1059] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.751217  6982 leader_election.cc:304] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:09.751335  8210 raft_consensus.cc:697] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:09.752091  8241 raft_consensus.cc:3055] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:09.743865  8222 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.752462  8241 raft_consensus.cc:740] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:09.752534  6982 leader_election.cc:304] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:09.761683  8144 raft_consensus.cc:2804] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.753824  8222 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.754555  8111 raft_consensus.cc:3055] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:09.769711  8111 raft_consensus.cc:740] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:09.769846  7083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 232) took 1085 ms. Trace:
I20260709 12:27:09.770561  8111 consensus_queue.cc:260] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.770256  7083 rpcz_store.cc:276] 0709 12:27:08.684321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.765956 (+1081635us) service_pool.cc:224] Handling call
0709 12:27:09.766336 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:09.766695 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:09.766729 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:09.767281 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 12:27:09.768885 (+  1604us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:27:09.768935 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.769013 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:09.769644 (+   631us) raft_consensus.cc:1685] finished
0709 12:27:09.769666 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:09.769791 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1177,"threads_started":1,"wal-append.queue_time_us":821}
I20260709 12:27:09.771878  8111 raft_consensus.cc:3060] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:09.754357  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.752468  8210 consensus_queue.cc:237] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.755579  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.755892  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:09.774617  7239 raft_consensus.cc:3060] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:09.758302  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:09.776881  7086 raft_consensus.cc:2468] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:09.758862  7670 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:09.757081  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:09.778893  7238 raft_consensus.cc:2410] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:27:09.753715  8135 leader_election.cc:290] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.773398  7236 raft_consensus.cc:2468] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:09.762223  6982 leader_election.cc:304] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:09.783744  8280 raft_consensus.cc:3060] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.786023  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.786829  7236 raft_consensus.cc:2468] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:09.752667  8278 raft_consensus.cc:2749] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:09.756929  8241 consensus_queue.cc:260] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:09.790652  8241 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.756513  7235 raft_consensus.cc:2468] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
W20260709 12:27:09.793705  8264 log.cc:927] Time spent T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.435s	user 0.000s	sys 0.004s
I20260709 12:27:09.793749  7239 raft_consensus.cc:2468] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:09.777956  8222 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.809156  8222 raft_consensus.cc:493] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.810305  8222 raft_consensus.cc:515] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:09.798543  7202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.801232  7205 leader_election.cc:304] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:09.812626  8222 leader_election.cc:290] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:09.786114  7055 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:09.754834  7990 raft_consensus.cc:515] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.812784  8072 raft_consensus.cc:2804] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:09.813968  8072 raft_consensus.cc:697] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:09.814194  7055 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:09.814894  8072 consensus_queue.cc:237] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.815590  8226 raft_consensus.cc:2804] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:09.816046  8226 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.816380  8226 raft_consensus.cc:3060] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.818327  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.820123  7990 leader_election.cc:290] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.814996  8135 raft_consensus.cc:2749] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:09.821794  7055 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:09.822582  8135 raft_consensus.cc:2804] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:09.822682  7055 leader_election.cc:304] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:09.823021  8135 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.823439  8135 raft_consensus.cc:3060] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.823647  7055 leader_election.cc:304] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:09.762245  8144 raft_consensus.cc:697] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:09.826591  8144 consensus_queue.cc:237] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:09.828912  8216 consensus_queue.cc:1048] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:09.829977  7990 raft_consensus.cc:2804] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.838243  7990 raft_consensus.cc:697] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
W20260709 12:27:09.839696  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 77557.5us
W20260709 12:27:09.840039  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.832072  7205 leader_election.cc:304] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:09.824537  7055 leader_election.cc:304] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:09.841015  8216 raft_consensus.cc:493] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:09.841310  8178 raft_consensus.cc:2804] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:09.841750  8178 raft_consensus.cc:493] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.841544  8216 raft_consensus.cc:515] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.842142  8178 raft_consensus.cc:3060] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:09.392261  7082 raft_consensus.cc:2468] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:09.843765  8216 leader_election.cc:290] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:09.843886  7090 raft_consensus.cc:3060] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:09.834717  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 433608us
I20260709 12:27:09.845098  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.845211  7990 consensus_queue.cc:237] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.846014  7232 raft_consensus.cc:2410] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:27:09.846920  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:09.841303  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:09.847813  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:09.845244  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:09.848877  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:09.847769  7086 raft_consensus.cc:1275] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:09.849416  7082 raft_consensus.cc:2468] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:09.849803  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:09.835172  8222 raft_consensus.cc:2804] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:09.849815  7087 raft_consensus.cc:2468] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:27:09.836921  8084 raft_consensus.cc:2804] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:09.850422  8215 consensus_queue.cc:1059] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:09.852278  8215 raft_consensus.cc:3055] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:09.852612  8215 raft_consensus.cc:740] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:09.853417  8215 consensus_queue.cc:260] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.854182  8135 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.854475  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:09.849432  7239 raft_consensus.cc:3060] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:09.856855  7088 raft_consensus.cc:2393] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 5: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:09.858069  6912 catalog_manager.cc:5697] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca reported cstate change: term changed from 1 to 2, leader changed from e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68) to 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66). New cstate: current_term: 2 leader_uuid: "9e6e5c8ad44447588681b10df7ad79ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:09.859826  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.861068  7237 raft_consensus.cc:1275] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:27:09.863777  8254 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.846853  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:09.834278  8226 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:09.869262  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:09.865069  8178 raft_consensus.cc:515] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:09.870265  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.871116  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:09.872627  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:09.873003  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.869119  8133 raft_consensus.cc:493] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.872622  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:09.874117  8208 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.854648  8215 raft_consensus.cc:3060] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.902666  7129 leader_election.cc:304] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:09.880026  7239 raft_consensus.cc:2468] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:09.875357  8196 raft_consensus.cc:493] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.937213  7129 leader_election.cc:304] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:09.875556  8111 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.875794  8253 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.856283  8135 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.876169  8194 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.876613  8198 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.879043  6980 leader_election.cc:304] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:09.879520  8084 raft_consensus.cc:697] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:09.903318  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:09.908687  8226 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:09.880613  7205 leader_election.cc:304] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:09.868837  7090 raft_consensus.cc:1275] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:09.884524  7164 raft_consensus.cc:1275] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:27:09.890805  6914 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48280 (request call id 64) took 11319 ms (client timeout 15000 ms). Trace:
I20260709 12:27:09.902202  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:09.951102  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 70575.9us
I20260709 12:27:09.953048  7165 raft_consensus.cc:2468] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 4.
I20260709 12:27:09.888708  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:09.912015  7088 raft_consensus.cc:2468] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:09.910820  7231 raft_consensus.cc:2468] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 4.
I20260709 12:27:09.911116  7086 raft_consensus.cc:2468] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:09.902835  8271 consensus_queue.cc:1048] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:27:09.941550  7129 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:09.966569  7129 leader_election.cc:304] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:09.909562  8216 raft_consensus.cc:493] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.944023  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.945178  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.973443  7239 raft_consensus.cc:2393] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 3: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:09.898139  7011 raft_consensus.cc:3060] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:09.900980  7157 raft_consensus.cc:1240] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:09.951494  8241 raft_consensus.cc:2749] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:09.946853  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 67893.9us
I20260709 12:27:09.888337  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:09.840451  6982 leader_election.cc:304] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:09.910486  8178 leader_election.cc:290] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:09.838599  8280 raft_consensus.cc:2749] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:09.901436  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:09.898229  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:09.976145  8261 raft_consensus.cc:2804] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:09.953971  7205 leader_election.cc:304] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:09.940415  7233 raft_consensus.cc:3060] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.933188  7230 raft_consensus.cc:2468] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:09.891341  6912 catalog_manager.cc:5697] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca reported cstate change: term changed from 1 to 2, leader changed from 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66) to 022925662268440c91fff7e8732d7a0b (127.3.200.67). New cstate: current_term: 2 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } }
I20260709 12:27:09.942589  8195 raft_consensus.cc:2804] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:09.957199  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:10.019838  8195 raft_consensus.cc:493] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:10.020351  8195 raft_consensus.cc:3060] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:10.021001  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:09.998627  8213 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.022294  8213 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:10.022670  7165 raft_consensus.cc:1240] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:10.024222  7165 raft_consensus.cc:1275] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:10.025595  8160 raft_consensus.cc:493] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.021076  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:10.026207  8160 raft_consensus.cc:515] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.897753  8254 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:10.026690  7157 raft_consensus.cc:2468] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:09.945446  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:09.934401  8133 raft_consensus.cc:515] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:10.030308  8133 leader_election.cc:290] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.887941  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:09.944799  8111 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:10.032720  8111 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:09.979373  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:09.942685  8196 raft_consensus.cc:515] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.986325  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:09.957808  8144 raft_consensus.cc:2749] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:09.996912  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:09.958952  7156 raft_consensus.cc:2468] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:10.028350  8254 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.956609  7670 raft_consensus.cc:2804] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:09.968127  7129 leader_election.cc:304] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:10.047195  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 79177.6us
I20260709 12:27:09.940423  8208 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.947496  8253 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:09.952205  6914 rpcz_store.cc:269] 0709 12:26:58.571398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.572905 (+  1507us) service_pool.cc:224] Handling call
0709 12:27:09.890736 (+11317831us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:08.265393 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:08.266118 (+   725us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:08.266174 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:27:08.266195 (+    21us) tablet.cc:662] Decoding operations
0709 12:27:08.267042 (+   847us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:08.267144 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:08.267169 (+    25us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:27:08.267781 (+   612us) tablet.cc:701] Row locks acquired
0709 12:27:08.267830 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:27:08.268032 (+   202us) write_op.cc:270] Start()
0709 12:27:08.268178 (+   146us) write_op.cc:276] Timestamp: P: 1783600028267963 usec, L: 0
0709 12:27:08.268214 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:27:08.370128 (+101914us) log.cc:844] Serialized 2463 byte log entry
0709 12:27:08.877477 (+507349us) op_driver.cc:464] REPLICATION: finished
0709 12:27:09.031526 (+154049us) write_op.cc:301] APPLY: starting
0709 12:27:09.031643 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:09.055618 (+ 23975us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:09.055784 (+   166us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:09.060935 (+  5151us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:09.061572 (+   637us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:27:09.061646 (+    74us) write_op.cc:312] APPLY: finished
0709 12:27:09.061999 (+   353us) log.cc:844] Serialized 52 byte log entry
0709 12:27:09.076724 (+ 14725us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:09.076910 (+   186us) write_op.cc:454] Released schema lock
0709 12:27:09.077005 (+    95us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:09.077563 (+   558us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:09.077604 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":141511,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":153730,"apply.run_cpu_time_us":3476,"apply.run_wall_time_us":45978,"num_ops":6,"prepare.queue_time_us":208000,"prepare.run_cpu_time_us":24370,"prepare.run_wall_time_us":411497,"raft.queue_time_us":122380,"raft.run_cpu_time_us":7622,"raft.run_wall_time_us":82270,"replication_time_us":609108,"thread_start_us":473839,"threads_started":4,"wal-append.queue_time_us":323102}]]}
I20260709 12:27:09.874802  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:09.975906  8259 raft_consensus.cc:2804] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:10.009136  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:10.061888  6912 catalog_manager.cc:5697] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca reported cstate change: term changed from 1 to 2, leader changed from 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65) to 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66). New cstate: current_term: 2 leader_uuid: "9e6e5c8ad44447588681b10df7ad79ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:10.070045  8259 raft_consensus.cc:493] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:10.070243  7239 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:10.070587  8259 raft_consensus.cc:3060] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:10.042364  8160 leader_election.cc:290] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:10.074673  7011 raft_consensus.cc:2468] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:10.075801  8196 leader_election.cc:290] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:09.951519  8198 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:10.076462  7164 raft_consensus.cc:2468] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:10.078615  8198 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:27:10.012358  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 58489.3us
I20260709 12:27:10.015594  8222 raft_consensus.cc:697] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:10.015859  8084 consensus_queue.cc:237] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:10.016777  7158 raft_consensus.cc:2393] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 5: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
W20260709 12:27:10.016881  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 176496us
I20260709 12:27:09.885111  7237 pending_rounds.cc:85] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41: Aborting all ops after (but not including) 2
I20260709 12:27:10.044013  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:09.959272  7990 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.010178  8106 raft_consensus.cc:493] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.098234  7990 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:10.098340  8106 raft_consensus.cc:515] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:09.977617  8216 raft_consensus.cc:515] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:10.100644  7990 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:10.100732  8106 leader_election.cc:290] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:10.101449  8216 leader_election.cc:290] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:10.013753  8261 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.102142  8261 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:10.102576  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:10.103941  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:10.025844  8140 raft_consensus.cc:2804] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:10.057359  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:10.024385  8213 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:10.058727  7129 leader_election.cc:304] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:10.044032  8111 raft_consensus.cc:493] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.105520  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:10.105840  8271 raft_consensus.cc:2804] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:10.061873  7232 raft_consensus.cc:1275] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.106345  8271 raft_consensus.cc:697] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:10.052176  7670 raft_consensus.cc:493] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.106626  8208 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:10.106763  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:10.106988  7670 raft_consensus.cc:3060] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:10.107441  7163 raft_consensus.cc:2468] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:10.107261  8271 consensus_queue.cc:237] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:10.061946  7157 raft_consensus.cc:1240] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:10.109429  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:10.063431  8253 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:10.057420  8209 raft_consensus.cc:3060] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:10.033461  8210 raft_consensus.cc:2804] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:10.033793  7082 raft_consensus.cc:2468] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 1.
I20260709 12:27:10.064850  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:10.120025  7238 raft_consensus.cc:2468] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:10.066547  7234 raft_consensus.cc:2468] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:10.064170  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:10.069479  7160 raft_consensus.cc:2468] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:09.949065  8194 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:10.086417  7239 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 6.
I20260709 12:27:10.052424  7231 raft_consensus.cc:3060] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:10.140415  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 129131us
I20260709 12:27:10.094780  6982 leader_election.cc:304] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:10.095685  7237 pending_rounds.cc:107] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:27:10.093132  8160 consensus_queue.cc:1048] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:27:10.097606  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:10.151451  7165 raft_consensus.cc:2468] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:10.105342  8111 raft_consensus.cc:515] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:10.105311  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 46699.4us
I20260709 12:27:10.121235  8210 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:10.154037  7055 leader_election.cc:304] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:10.062040  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:10.110309  7159 raft_consensus.cc:2410] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:10.082178  7943 raft_consensus.cc:2804] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:27:10.161082  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 66425.8us
I20260709 12:27:10.161824  6982 leader_election.cc:304] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:10.108321  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:10.121639  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.162642  7205 leader_election.cc:304] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:10.163182  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.111985  7157 raft_consensus.cc:2468] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
W20260709 12:27:10.156229  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 87460us
I20260709 12:27:10.141170  6980 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:10.153004  7237 raft_consensus.cc:2889] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:10.152611  8106 raft_consensus.cc:2749] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:10.168229  7129 leader_election.cc:304] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:10.168112  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:10.174070  6980 leader_election.cc:304] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:10.148103  7235 raft_consensus.cc:2468] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:10.175596  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:10.163832  7205 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:10.164062  8241 raft_consensus.cc:2749] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:10.158221  8210 raft_consensus.cc:3060] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:10.187858  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:10.188989  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:10.192291  7205 leader_election.cc:304] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:10.193027  6982 leader_election.cc:304] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:10.194293  8302 raft_consensus.cc:2749] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:10.164588  8297 raft_consensus.cc:493] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.170433  8216 raft_consensus.cc:2804] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:10.199575  8216 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.199981  8216 raft_consensus.cc:3060] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.200439  7161 raft_consensus.cc:2468] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:10.200687  7943 raft_consensus.cc:493] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:10.201130  7943 raft_consensus.cc:3060] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.203238  8195 raft_consensus.cc:515] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:10.204447  7156 raft_consensus.cc:1275] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:10.204733  7971 raft_consensus.cc:2804] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:10.205189  7971 raft_consensus.cc:493] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.205525  7971 raft_consensus.cc:3060] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:10.208752  8282 raft_consensus.cc:2804] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:10.209183  8282 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.209578  8282 raft_consensus.cc:3060] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:10.209892  8111 leader_election.cc:290] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:10.212492  8194 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:10.195861  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:10.213469  7239 raft_consensus.cc:2468] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:10.213691  7157 raft_consensus.cc:1275] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:27:10.165304  7162 raft_consensus.cc:2468] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:10.198741  8157 raft_consensus.cc:2804] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:10.214287  7231 raft_consensus.cc:2468] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 5.
I20260709 12:27:10.214459  8157 raft_consensus.cc:493] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:10.214709  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:10.214865  8259 raft_consensus.cc:515] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:10.215399  7157 raft_consensus.cc:2468] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:10.190878  8252 raft_consensus.cc:2804] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:10.214939  8157 raft_consensus.cc:3060] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:10.220183  7943 raft_consensus.cc:515] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:10.220650  8297 raft_consensus.cc:515] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:10.161444  7990 consensus_queue.cc:1048] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:27:10.222766  8297 leader_election.cc:290] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:10.242182  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:10.242808  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:10.243839  7971 raft_consensus.cc:515] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:10.245509  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:10.246147  7165 raft_consensus.cc:2468] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:10.241102  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:10.247206  7163 raft_consensus.cc:2468] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:10.175411  8254 consensus_queue.cc:1048] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 12:27:10.247960  8195 leader_election.cc:290] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:10.166059  8213 consensus_queue.cc:1048] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:27:10.248855  8261 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:10.250805  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:10.251199  8157 raft_consensus.cc:515] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:10.248379  7233 raft_consensus.cc:2468] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 5.
I20260709 12:27:10.247452  7990 raft_consensus.cc:493] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:10.254300  7164 raft_consensus.cc:1275] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:27:10.254730  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 57948.1us
I20260709 12:27:10.261159  6980 leader_election.cc:304] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:10.234335  7129 leader_election.cc:304] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:10.189548  8280 raft_consensus.cc:2804] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:10.275009  8280 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:10.224442  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.275607  8280 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:10.250954  8261 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:10.284785  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:10.285214  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 50982.6us
I20260709 12:27:10.285681  7239 raft_consensus.cc:2393] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 5: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:10.287242  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:10.283468  6980 leader_election.cc:304] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
W20260709 12:27:10.287350  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 137912us
I20260709 12:27:10.195044  8302 consensus_queue.cc:1059] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.063s
I20260709 12:27:10.193029  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:10.205587  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:10.279646  8278 raft_consensus.cc:2749] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:10.291724  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 98379.4us
W20260709 12:27:10.290881  7054 leader_election.cc:336] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Timed out: RequestConsensusVote RPC to 127.3.200.65:34921 timed out after 1.690s (SENT)
I20260709 12:27:10.253885  8209 raft_consensus.cc:2749] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:10.216881  8252 raft_consensus.cc:493] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.300499  8252 raft_consensus.cc:3060] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:10.301884  7670 raft_consensus.cc:515] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:10.304165  7230 raft_consensus.cc:1240] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:10.222570  7943 leader_election.cc:290] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:10.222779  8140 raft_consensus.cc:493] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:10.297919  6982 leader_election.cc:304] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:10.296571  8307 raft_consensus.cc:493] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:10.305075  8140 raft_consensus.cc:3060] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:10.305362  7202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.282918  8106 consensus_queue.cc:1048] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:27:10.293071  8195 raft_consensus.cc:2804] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:10.298538  7129 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:10.291805  8199 raft_consensus.cc:2804] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:27:10.314968  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 109251us
I20260709 12:27:10.300336  7971 leader_election.cc:290] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:10.318935  7128 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:10.296836  7159 raft_consensus.cc:1275] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.328847  7055 leader_election.cc:304] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:10.305387  8297 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.352281  7090 raft_consensus.cc:1275] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.352385  7055 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:10.307623  7670 leader_election.cc:290] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:10.361811  7055 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:10.197502  8222 consensus_queue.cc:237] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:10.291805  7990 raft_consensus.cc:515] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:10.373422  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 75605.7us
I20260709 12:27:10.369068  7203 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:10.372618  7088 raft_consensus.cc:1275] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.374197  6982 leader_election.cc:304] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:10.316419  8144 raft_consensus.cc:2804] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:10.322177  8208 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.375626  7203 leader_election.cc:304] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:10.376462  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:10.347467  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
W20260709 12:27:10.372660  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 89306us
I20260709 12:27:10.346495  8261 raft_consensus.cc:2804] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:10.380530  7055 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:10.430390  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:10.431169  7014 raft_consensus.cc:2468] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:10.381752  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:10.432205  7090 raft_consensus.cc:2468] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:10.381251  8072 raft_consensus.cc:2749] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:10.322880  8195 raft_consensus.cc:493] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.383354  6982 leader_election.cc:304] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:10.364800  8293 raft_consensus.cc:2804] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:10.322640  8199 raft_consensus.cc:493] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.364583  7943 raft_consensus.cc:2804] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:10.437368  7203 leader_election.cc:304] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:10.386272  6980 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:10.439981  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:10.444309  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:10.364951  8300 raft_consensus.cc:2804] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:10.446663  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:10.446738  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:10.449662  7088 raft_consensus.cc:3060] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:10.449928  7090 raft_consensus.cc:3060] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:10.447865  7131 leader_election.cc:304] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:10.380750  8144 raft_consensus.cc:493] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:10.364581  8297 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:10.432662  7233 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:10.386986  8157 leader_election.cc:290] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:10.470623  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:10.470912  7128 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:10.452752  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:10.427778  8261 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.456763  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:10.372920  8194 consensus_queue.cc:1059] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:27:10.433565  8160 raft_consensus.cc:2804] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:10.387749  8301 raft_consensus.cc:2804] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:10.436228  8302 consensus_queue.cc:1243] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer 022925662268440c91fff7e8732d7a0b log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:27:10.379263  8253 consensus_queue.cc:1048] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.068s
I20260709 12:27:10.439304  8199 raft_consensus.cc:3060] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:10.439517  8195 raft_consensus.cc:3060] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.469182  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:10.477310  7013 raft_consensus.cc:2468] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:10.453890  8241 raft_consensus.cc:2804] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:10.461321  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:10.452339  8293 raft_consensus.cc:697] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:10.431545  8208 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:10.435729  8111 consensus_queue.cc:1048] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 12:27:10.461709  8144 raft_consensus.cc:3060] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:10.519321  7128 leader_election.cc:304] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:10.607616  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 129648us
I20260709 12:27:10.543439  7088 raft_consensus.cc:2468] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:10.610057  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:10.610812  7088 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 5.
I20260709 12:27:10.314208  8307 raft_consensus.cc:515] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:10.544525  7090 raft_consensus.cc:2468] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
W20260709 12:27:10.546554  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 166114us
I20260709 12:27:10.613848  7055 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:10.614018  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:27:10.477577  7037 debug-util.cc:398] Leaking SignalData structure 0x7b08002baf20 after lost signal to thread 3876
I20260709 12:27:10.471777  8106 raft_consensus.cc:2804] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:10.523136  8196 raft_consensus.cc:2804] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:10.468871  8259 leader_election.cc:290] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:27:10.623215  8311 log.cc:927] Time spent T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:27:10.544817  8282 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:10.628178  8282 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:10.628895  8282 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.629383  8282 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:10.550443  8301 raft_consensus.cc:697] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [term 5 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:10.614650  7090 raft_consensus.cc:2468] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:10.517258  8261 raft_consensus.cc:3060] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.614713  7055 leader_election.cc:304] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:10.608860  7128 leader_election.cc:304] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:10.543933  8072 raft_consensus.cc:2804] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:27:10.549795  8215 consensus_meta.cc:287] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.609s	user 0.016s	sys 0.008s
I20260709 12:27:10.546840  8278 raft_consensus.cc:2749] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:10.600365  8194 raft_consensus.cc:2804] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:10.547190  8160 raft_consensus.cc:493] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.620352  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:10.604784  8178 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.605404  8241 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.604694  8302 raft_consensus.cc:2804] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:10.633410  8209 raft_consensus.cc:2749] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:10.470939  8314 raft_consensus.cc:2764] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:27:10.612207  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:27:10.642268  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 259034us
I20260709 12:27:10.695871  6982 leader_election.cc:304] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:10.616429  8309 raft_consensus.cc:3055] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:27:10.654974  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 217686us
I20260709 12:27:10.644670  8072 raft_consensus.cc:493] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:10.651710  8135 raft_consensus.cc:2804] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:10.719602  7203 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:10.640444  7205 leader_election.cc:304] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:10.658507  7236 raft_consensus.cc:2410] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:27:10.630537  8196 raft_consensus.cc:493] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.633698  8299 raft_consensus.cc:2804] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:10.673213  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:10.728571  7088 raft_consensus.cc:3060] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:10.633302  8106 raft_consensus.cc:697] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
W20260709 12:27:10.731980  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 91644.6us
I20260709 12:27:10.733183  7205 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:10.603964  7943 raft_consensus.cc:697] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [term 5 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:10.693065  8302 raft_consensus.cc:697] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:10.693610  8282 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:10.666584  8111 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:10.694108  8208 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:10.666976  8241 raft_consensus.cc:3060] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:10.651518  8084 raft_consensus.cc:2749] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:10.656684  8194 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.729100  7203 leader_election.cc:304] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:10.730291  7202 leader_election.cc:304] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:10.662040  8160 raft_consensus.cc:3060] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:10.672425  7037 debug-util.cc:398] Leaking SignalData structure 0x7b0800341f00 after lost signal to thread 6948
W20260709 12:27:10.753389  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 305614us
I20260709 12:27:10.666798  8178 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:10.819165  7011 raft_consensus.cc:3055] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:10.819657  7011 raft_consensus.cc:740] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:10.820797  8178 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:10.821231  7232 raft_consensus.cc:1240] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:27:10.752748  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 366513us
I20260709 12:27:10.777745  8320 raft_consensus.cc:2764] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:27:10.826470  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:10.820420  7011 consensus_queue.cc:260] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:10.740767  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:10.831348  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:10.832419  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:10.833422  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:10.834358  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:10.835286  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:10.718700  8309 raft_consensus.cc:740] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:10.772750  7088 raft_consensus.cc:2468] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:10.747529  7990 leader_election.cc:290] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:10.836810  8309 consensus_queue.cc:260] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:10.737442  7205 leader_election.cc:304] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:10.654894  8252 raft_consensus.cc:515] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:10.731564  8196 raft_consensus.cc:3060] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:10.726933  8072 raft_consensus.cc:3060] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.727527  8135 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:10.736914  8278 raft_consensus.cc:2804] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:27:10.762498  8216 consensus_meta.cc:287] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.000s
I20260709 12:27:10.784523  8301 consensus_queue.cc:237] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:10.843457  8216 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:10.845506  8216 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:10.731693  8299 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.747840  8213 raft_consensus.cc:2804] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:10.693655  7161 raft_consensus.cc:1240] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:10.736379  7670 raft_consensus.cc:2804] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:10.731341  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:10.787317  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:10.787719  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:10.731029  8293 consensus_queue.cc:237] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:10.764393  8300 raft_consensus.cc:697] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:10.788131  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:10.857964  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:10.858403  7010 raft_consensus.cc:2393] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 3: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:10.859166  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:10.859328  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:10.859954  7008 raft_consensus.cc:2393] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 6: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:10.846936  8278 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.860791  8278 raft_consensus.cc:3060] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.860800  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:10.861127  8300 consensus_queue.cc:237] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:10.789055  8302 consensus_queue.cc:237] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:10.789767  8282 raft_consensus.cc:2749] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:10.790431  8322 raft_consensus.cc:2749] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:10.789539  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 59358.1us
W20260709 12:27:10.793656  7037 debug-util.cc:398] Leaking SignalData structure 0x7b08000ecae0 after lost signal to thread 7040
W20260709 12:27:10.789077  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 60101.7us
I20260709 12:27:10.798543  8106 consensus_queue.cc:237] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:10.805087  8307 leader_election.cc:290] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:10.886322  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:10.810889  8210 consensus_meta.cc:287] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.001s
W20260709 12:27:10.813207  8280 consensus_meta.cc:287] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 0.537s	user 0.005s	sys 0.006s
I20260709 12:27:10.815330  8199 raft_consensus.cc:515] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:10.991883  8199 leader_election.cc:290] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:10.816867  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:10.994654  8199 raft_consensus.cc:493] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:10.995262  7087 raft_consensus.cc:3060] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:10.995221  8199 raft_consensus.cc:515] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:10.817679  7082 raft_consensus.cc:1275] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.997315  8199 leader_election.cc:290] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:10.997879  8196 raft_consensus.cc:515] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:10.824324  6980 leader_election.cc:304] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:11.000370  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 176116us
I20260709 12:27:10.740233  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:10.835772  7016 raft_consensus.cc:2376] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 5. Re-sending same reply.
W20260709 12:27:10.838219  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 100852us
I20260709 12:27:11.003906  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:10.786228  8194 raft_consensus.cc:3060] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:10.789589  8315 log.cc:927] Time spent T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:27:10.842207  8320 raft_consensus.cc:2804] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:10.856907  7156 raft_consensus.cc:2393] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 3: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:10.984421  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:10.841457  8135 raft_consensus.cc:3060] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:11.019481  8320 raft_consensus.cc:697] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:11.019707  7008 raft_consensus.cc:2468] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:10.789403  7233 raft_consensus.cc:2468] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 5.
I20260709 12:27:10.847887  8299 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:11.020843  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:11.020761  8320 consensus_queue.cc:237] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:10.776911  8111 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:10.860005  8261 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:10.852257  7670 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.966701  7203 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:10.806281  8160 raft_consensus.cc:515] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:10.862105  7158 raft_consensus.cc:2468] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 5.
W20260709 12:27:10.965996  7037 debug-util.cc:398] Leaking SignalData structure 0x7b08000ae120 after lost signal to thread 7041
I20260709 12:27:10.862159  8213 raft_consensus.cc:697] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:10.896874  7007 raft_consensus.cc:2468] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:10.851773  8195 raft_consensus.cc:515] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:11.000212  8196 leader_election.cc:290] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:11.002717  6980 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:11.055606  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 52971.3us
I20260709 12:27:11.006891  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:11.014945  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:10.861567  7084 raft_consensus.cc:2468] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:11.021623  7008 raft_consensus.cc:2468] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:27:10.846704  8309 raft_consensus.cc:3060] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:11.063228  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:10.900064  7943 consensus_queue.cc:237] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:11.005889  8325 raft_consensus.cc:2749] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:11.030587  7670 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:11.037365  8216 raft_consensus.cc:2749] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:11.038445  8327 raft_consensus.cc:493] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.030123  8144 raft_consensus.cc:515] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:11.059791  8318 raft_consensus.cc:2804] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:27:11.054268  8140 consensus_meta.cc:287] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.708s	user 0.010s	sys 0.002s
I20260709 12:27:11.069720  7233 raft_consensus.cc:1275] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:11.070008  8195 leader_election.cc:290] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:11.070776  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:11.064218  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:11.071856  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:11.005298  8210 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:11.035171  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 68590.7us
I20260709 12:27:11.085980  7008 raft_consensus.cc:3060] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:11.077291  7202 leader_election.cc:304] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:11.004807  8280 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:11.018791  8072 raft_consensus.cc:515] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:11.090291  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:11.025784  8322 consensus_queue.cc:1048] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.055s
I20260709 12:27:11.107813  8282 consensus_queue.cc:1048] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:11.084931  8199 consensus_queue.cc:1048] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 12:27:11.085642  7037 debug-util.cc:398] Leaking SignalData structure 0x7b08000eddc0 after lost signal to thread 7115
I20260709 12:27:11.098912  8111 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:11.099267  7234 raft_consensus.cc:1240] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:11.016332  7010 raft_consensus.cc:2468] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:11.100103  8318 raft_consensus.cc:697] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 6 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:11.107234  7015 raft_consensus.cc:2468] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:11.108914  7203 leader_election.cc:304] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:11.082067  8252 leader_election.cc:290] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:11.112519  7202 leader_election.cc:304] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:11.104194  7007 raft_consensus.cc:3060] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:11.116485  7014 raft_consensus.cc:2393] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 5: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
W20260709 12:27:11.116900  7037 debug-util.cc:398] Leaking SignalData structure 0x7b0800116440 after lost signal to thread 7116
I20260709 12:27:11.096458  8213 consensus_queue.cc:237] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:11.094636  8327 raft_consensus.cc:515] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:11.123292  8261 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:11.096230  8140 raft_consensus.cc:515] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:11.169381  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 60534.7us
I20260709 12:27:11.114432  8178 raft_consensus.cc:493] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.106405  7232 raft_consensus.cc:2468] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:11.114596  8307 raft_consensus.cc:2749] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:11.114378  8157 consensus_queue.cc:1048] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260709 12:27:11.211601  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 99575.1us
I20260709 12:27:11.198357  8111 raft_consensus.cc:493] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.221096  7670 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:11.213583  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:11.218938  8327 leader_election.cc:290] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:11.213661  8312 consensus_queue.cc:1048] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:27:11.216714  8282 raft_consensus.cc:2749] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:11.234498  7202 leader_election.cc:304] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:11.199330  8313 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:11.214558  7037 debug-util.cc:398] Leaking SignalData structure 0x7b08003a0a40 after lost signal to thread 7189
I20260709 12:27:11.237577  8325 consensus_queue.cc:1059] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:27:11.212106  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:11.246304  7670 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:11.212915  8316 raft_consensus.cc:2804] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:11.217995  7008 raft_consensus.cc:2468] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:11.212716  8241 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:11.257145  7203 leader_election.cc:304] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:11.244855  8280 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:11.246330  8160 leader_election.cc:290] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:11.267910  7089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46252 (request call id 255) took 1414 ms. Trace:
W20260709 12:27:11.270709  7129 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.272816  7670 raft_consensus.cc:2749] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:11.272207  7089 rpcz_store.cc:276] 0709 12:27:09.845851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.846688 (+   837us) service_pool.cc:224] Handling call
0709 12:27:11.260486 (+1413798us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540032f354. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:11.260649 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2702772608}
I20260709 12:27:11.252058  8316 raft_consensus.cc:493] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.253659  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:11.277029  7091 raft_consensus.cc:2393] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 3: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:11.236030  8178 raft_consensus.cc:515] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:11.240190  8111 raft_consensus.cc:515] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:11.277987  7129 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:11.278957  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 44558.9us
I20260709 12:27:11.286962  7202 leader_election.cc:304] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:11.288609  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:11.267990  7159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56794 (request call id 250) took 1172 ms. Trace:
I20260709 12:27:11.288940  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:11.279443  8195 consensus_queue.cc:1059] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:27:11.289891  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:11.290325  8195 raft_consensus.cc:3055] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:11.290779  8195 raft_consensus.cc:740] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:11.288879  8072 leader_election.cc:290] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:11.290045  8330 raft_consensus.cc:2804] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:11.291706  8330 raft_consensus.cc:697] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 5 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:11.291525  8195 consensus_queue.cc:260] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:11.248479  8313 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:11.292729  8330 consensus_queue.cc:237] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:11.293090  8194 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:11.279433  8144 leader_election.cc:290] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:11.294442  8195 raft_consensus.cc:3060] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:11.295257  8194 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:11.295809  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:11.296043  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:11.289433  7159 rpcz_store.cc:276] 0709 12:27:10.095677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.197300 (+101623us) service_pool.cc:224] Handling call
0709 12:27:10.199930 (+  2630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:10.355667 (+155737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:11.251670 (+896003us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b540011c6d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:11.265860 (+ 14190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58954496}
I20260709 12:27:11.251464  8307 consensus_queue.cc:1048] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:27:11.297886  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:11.298517  7162 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:11.298614  7165 raft_consensus.cc:3060] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:11.296705  7164 raft_consensus.cc:2468] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 5.
I20260709 12:27:11.302613  7670 raft_consensus.cc:3060] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:11.271703  8133 raft_consensus.cc:493] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.305310  7202 leader_election.cc:304] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:11.300243  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:11.280071  7037 debug-util.cc:398] Leaking SignalData structure 0x7b08001237c0 after lost signal to thread 7263
I20260709 12:27:11.239223  8318 consensus_queue.cc:237] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:11.278831  8316 raft_consensus.cc:3060] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:11.281373  7230 raft_consensus.cc:1240] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:11.279713  8280 raft_consensus.cc:3055] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:27:11.315140  7037 debug-util.cc:398] Leaking SignalData structure 0x7b08003a00c0 after lost signal to thread 7264
I20260709 12:27:11.296435  7012 raft_consensus.cc:3060] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:11.337320  7165 raft_consensus.cc:2468] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:11.315229  7202 leader_election.cc:304] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:11.340973  7202 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:11.336789  8347 raft_consensus.cc:2804] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:11.339239  7161 raft_consensus.cc:2410] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:27:11.339483  8338 log.cc:927] Time spent T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:27:11.316134  7011 raft_consensus.cc:3060] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:11.342152  8307 raft_consensus.cc:2764] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:27:11.342823  7086 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 263) took 1025 ms. Trace:
I20260709 12:27:11.343106  7202 leader_election.cc:304] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:11.281431  8196 consensus_queue.cc:1059] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:27:11.345415  8072 raft_consensus.cc:2764] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:27:11.356077  8320 raft_consensus.cc:2804] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:11.356935  8320 raft_consensus.cc:493] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.357528  8320 raft_consensus.cc:3060] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:11.358781  8196 raft_consensus.cc:3055] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:11.359210  8196 raft_consensus.cc:740] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:11.359989  8196 consensus_queue.cc:260] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:11.361196  8196 raft_consensus.cc:3060] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:11.364645  8299 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:11.365618  8178 leader_election.cc:290] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:11.366801  8299 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:11.368110  8297 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:11.369194  8340 log.cc:927] Time spent T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:27:11.370364  7084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 269) took 1042 ms. Trace:
I20260709 12:27:11.353909  8135 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:11.371165  8313 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:11.372251  8135 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:11.357105  8339 log.cc:927] Time spent T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:27:11.370770  7084 rpcz_store.cc:276] 0709 12:27:10.328242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.066420 (+738178us) service_pool.cc:224] Handling call
0709 12:27:11.066750 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:11.067122 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:11.067150 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:11.067657 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:27:11.226426 (+158769us) raft_consensus.cc:1645] Marking committed up to 0
0709 12:27:11.226475 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:11.226552 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:11.370076 (+143524us) raft_consensus.cc:1685] finished
0709 12:27:11.370104 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:11.370299 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":153889,"threads_started":1,"wal-append.queue_time_us":178362}
I20260709 12:27:11.343693  8347 raft_consensus.cc:493] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.409381  8347 raft_consensus.cc:3060] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:11.378314  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:11.379307  7007 raft_consensus.cc:2468] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 5.
I20260709 12:27:11.379438  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:11.351523  8301 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.354653  7086 rpcz_store.cc:276] 0709 12:27:10.317677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.322320 (+  4643us) service_pool.cc:224] Handling call
0709 12:27:11.330792 (+1008472us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:11.342289 (+ 11497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:11.342474 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:11.342505 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:11.342548 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:11.342583 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:11.342659 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:11.342768 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9627904}
I20260709 12:27:11.381170  8320 raft_consensus.cc:515] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:11.382580  7037 debug-util.cc:398] Leaking SignalData structure 0x7b08002d31a0 after lost signal to thread 8174
W20260709 12:27:11.339483  8332 log.cc:927] Time spent T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:27:11.340077  8280 raft_consensus.cc:740] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:11.393196  8313 raft_consensus.cc:493] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:11.396592  8241 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:11.400935  8111 leader_election.cc:290] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:11.404515  8261 raft_consensus.cc:493] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:11.407898  7012 raft_consensus.cc:2468] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:11.396142  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:11.430281  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 217745us
W20260709 12:27:11.483144  7037 debug-util.cc:398] Leaking SignalData structure 0x7b08001f8fe0 after lost signal to thread 8192
I20260709 12:27:11.463415  7156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56794 (request call id 259) took 1248 ms. Trace:
I20260709 12:27:11.351877  7670 raft_consensus.cc:2749] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:11.447100  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:11.448429  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:11.459329  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:11.476977  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
W20260709 12:27:11.482656  8278 consensus_meta.cc:287] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.007s
I20260709 12:27:11.315009  8133 raft_consensus.cc:515] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:11.498260  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.508877  6980 leader_election.cc:304] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:11.501132  7014 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:11.504546  7236 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49160 (request call id 220) took 1645 ms (client timeout 2035 ms). Trace:
W20260709 12:27:11.510008  7236 rpcz_store.cc:269] 0709 12:27:09.859446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.859565 (+   119us) service_pool.cc:224] Handling call
0709 12:27:11.500760 (+1641195us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b5400566654. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:11.504491 (+  3731us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1778071936}
I20260709 12:27:11.510807  7670 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:11.484933  8140 leader_election.cc:290] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:11.511521  7670 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:11.514506  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:11.514659  7128 leader_election.cc:304] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:11.515861  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:11.513796  6980 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:11.493417  7087 raft_consensus.cc:1275] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:11.493530  8327 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.518755  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:11.516537  7015 raft_consensus.cc:2468] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:11.462535  8301 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:11.525712  7128 leader_election.cc:304] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:11.499291  8302 raft_consensus.cc:493] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.538241  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:11.512389  7085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 277) took 1142 ms. Trace:
I20260709 12:27:11.488281  8313 raft_consensus.cc:515] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:11.513759  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:11.521387  8195 raft_consensus.cc:2804] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:11.495520  8261 raft_consensus.cc:515] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:11.512851  7037 debug-util.cc:398] Leaking SignalData structure 0x7b08003636a0 after lost signal to thread 8214
I20260709 12:27:11.548753  8301 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:11.542356  8300 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.549623  8157 raft_consensus.cc:493] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.526862  7670 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:11.521469  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:11.526506  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:11.512545  8278 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:11.556432  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:11.554772  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:11.554051  8302 raft_consensus.cc:515] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:11.535651  7082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 267) took 1205 ms. Trace:
I20260709 12:27:11.499459  7156 rpcz_store.cc:276] 0709 12:27:10.205069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.205330 (+   261us) service_pool.cc:224] Handling call
0709 12:27:11.408946 (+1203616us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b540063f954. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:11.453495 (+ 44549us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274085120}
I20260709 12:27:11.542706  8342 raft_consensus.cc:2764] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:27:11.546308  7087 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 276) took 1223 ms. Trace:
I20260709 12:27:11.534212  8327 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:11.562870  7037 debug-util.cc:398] Leaking SignalData structure 0x7b0800100de0 after lost signal to thread 8223
I20260709 12:27:11.523662  8280 consensus_queue.cc:260] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:11.570978  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:11.588340  7016 raft_consensus.cc:2468] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:11.572584  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:11.561480  8111 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:11.574776  8313 leader_election.cc:290] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:11.560019  8195 raft_consensus.cc:697] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:11.589182  8320 leader_election.cc:290] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:11.570760  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
W20260709 12:27:11.580467  8345 log.cc:927] Time spent T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:27:11.580610  7014 raft_consensus.cc:2468] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 5.
I20260709 12:27:11.583039  8261 leader_election.cc:290] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:11.584228  7089 raft_consensus.cc:1275] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:11.621042  7007 raft_consensus.cc:2368] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 2. Current term is 3.
I20260709 12:27:11.587889  7013 raft_consensus.cc:2393] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 4: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:11.589715  7054 leader_election.cc:304] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:11.607762  7239 raft_consensus.cc:2468] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:11.564572  8282 raft_consensus.cc:2749] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:11.558802  8297 raft_consensus.cc:2804] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:11.566882  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:11.568842  8199 raft_consensus.cc:2749] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:11.587486  8210 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:11.589370  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:11.673554  8327 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:11.566123  8300 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:11.650682  7084 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 5.
I20260709 12:27:11.668699  7232 raft_consensus.cc:3060] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:11.552409  7085 rpcz_store.cc:276] 0709 12:27:10.364900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.251897 (+886997us) service_pool.cc:224] Handling call
0709 12:27:11.281585 (+ 29688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:11.296820 (+ 15235us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:11.297134 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 12:27:11.442917 (+145783us) log.cc:844] Serialized 14 byte log entry
0709 12:27:11.478436 (+ 35519us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:11.485119 (+  6683us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:11.488333 (+  3214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:11.493568 (+  5235us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:11.507430 (+ 13862us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34975,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":87,"raft.queue_time_us":12156,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":12691,"thread_start_us":40626,"threads_started":1,"wal-append.queue_time_us":83954}
I20260709 12:27:11.675849  8300 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:11.623279  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 109552us
W20260709 12:27:11.609417  7037 debug-util.cc:398] Leaking SignalData structure 0x7b08001d5c40 after lost signal to thread 8230
I20260709 12:27:11.666005  7089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 273) took 1026 ms. Trace:
I20260709 12:27:11.584486  8316 raft_consensus.cc:515] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:11.567662  8157 raft_consensus.cc:515] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:11.585188  8348 log.cc:927] Time spent T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:27:11.668298  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:11.668695  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 80561.9us
I20260709 12:27:11.665886  8313 raft_consensus.cc:493] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.681974  7014 raft_consensus.cc:2393] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 2: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:11.587409  8278 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:11.671231  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:11.672102  7160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56782 (request call id 179) took 1292 ms. Trace:
I20260709 12:27:11.672329  8133 leader_election.cc:290] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:11.619761  8111 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:11.676865  7089 rpcz_store.cc:276] 0709 12:27:10.640048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.313571 (+673523us) service_pool.cc:224] Handling call
0709 12:27:11.583674 (+270103us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:11.583875 (+   201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:11.665689 (+ 81814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:11.665950 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14607744}
I20260709 12:27:11.687321  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:11.687857  7089 raft_consensus.cc:3060] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:11.560765  7237 raft_consensus.cc:3060] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:11.589497  8302 leader_election.cc:290] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:11.676656  7037 debug-util.cc:398] Leaking SignalData structure 0x7b0800199c00 after lost signal to thread 8237
I20260709 12:27:11.669318  8297 raft_consensus.cc:493] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.675943  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:11.684944  7054 leader_election.cc:304] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:11.719835  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:11.720463  7085 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 5.
I20260709 12:27:11.721758  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:11.722585  7054 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:11.723743  8157 leader_election.cc:290] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:11.676952  8135 raft_consensus.cc:2749] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:11.725051  8135 raft_consensus.cc:2749] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:11.725348  8316 leader_election.cc:290] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:11.725716  8135 raft_consensus.cc:2749] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:11.672132  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:11.729146  7012 raft_consensus.cc:1275] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:27:11.731184  8356 log.cc:927] Time spent T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:27:11.674315  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:11.733876  7231 raft_consensus.cc:1240] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:27:11.735109  7231 raft_consensus.cc:1240] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:11.678284  7008 raft_consensus.cc:2468] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:11.737185  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:11.738516  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:11.739341  7085 raft_consensus.cc:2393] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 5: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:11.695672  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:11.740545  7010 raft_consensus.cc:2468] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:11.741008  7239 raft_consensus.cc:2393] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 4: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:11.743896  7010 raft_consensus.cc:1240] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:11.697252  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:11.698046  7205 leader_election.cc:304] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:11.744899  7230 raft_consensus.cc:2468] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
W20260709 12:27:11.745229  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 47271.1us
I20260709 12:27:11.745095  8261 consensus_queue.cc:1048] T f91790bef199456db685133d1c9f6fc2 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:11.747108  7162 raft_consensus.cc:2468] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 5.
I20260709 12:27:11.748508  8322 raft_consensus.cc:2804] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:11.749069  8322 raft_consensus.cc:697] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:11.749930  8322 consensus_queue.cc:237] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:11.752102  8157 consensus_queue.cc:1048] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:11.740114  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:11.700841  7011 raft_consensus.cc:1275] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:27:11.703034  7129 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.756016  7085 raft_consensus.cc:3060] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:11.756626  7971 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:27:11.756283  7011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 281) took 1369 ms. Trace:
I20260709 12:27:11.757409  7011 rpcz_store.cc:276] 0709 12:27:10.429238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.439463 (+ 10225us) service_pool.cc:224] Handling call
0709 12:27:10.543276 (+103813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:10.819071 (+275795us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b54006da720. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f287818bdc0 00007f28782161c0 00007f2878217231 00007f2878213d8f 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c
0709 12:27:11.298920 (+479849us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b58003e06d0. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28781700aa 00007f28781f2447 00007f287820afe7 00007f287820c7de 00007f2878216b49 00007f2878217416 00007f2878213d8f 00007f287821383e 00007f287d1d8419 00007f287674fbd4
0709 12:27:11.755967 (+457047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:11.756226 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20433536}
I20260709 12:27:11.758404  7230 raft_consensus.cc:1275] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:27:11.758793  7230 pending_rounds.cc:85] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41: Aborting all ops after (but not including) 2
I20260709 12:27:11.759027  7230 pending_rounds.cc:107] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:27:11.759289  7230 raft_consensus.cc:2889] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:11.760607  8111 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:11.761267  8111 consensus_queue.cc:1048] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:11.763928  7085 raft_consensus.cc:2468] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:11.704597  8199 consensus_queue.cc:1059] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:11.779691  8199 consensus_queue.cc:1243] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer e6a8a26eb5294e4cb87412a7f2698f41 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:27:11.705363  7009 raft_consensus.cc:1275] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:11.707190  7089 raft_consensus.cc:2468] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:11.782006  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:11.782655  7089 raft_consensus.cc:2468] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:11.783458  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:11.784113  7089 raft_consensus.cc:2393] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 2: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:11.703688  7232 raft_consensus.cc:2468] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:11.708586  7016 raft_consensus.cc:1275] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:11.707870  7237 raft_consensus.cc:2468] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:11.688345  8327 consensus_queue.cc:1059] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:27:11.784741  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:11.785526  7236 raft_consensus.cc:2393] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 5: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:11.785653  8327 raft_consensus.cc:3055] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:11.786091  8327 raft_consensus.cc:740] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:11.787004  8327 consensus_queue.cc:260] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:11.613623  7087 rpcz_store.cc:276] 0709 12:27:10.323164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.994786 (+671622us) service_pool.cc:224] Handling call
0709 12:27:10.995126 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:11.523064 (+527938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:11.543754 (+ 20690us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:11.792785  7236 raft_consensus.cc:1240] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:11.793157  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:11.793401  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:11.794008  7087 raft_consensus.cc:2368] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3.
I20260709 12:27:11.793895  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:11.794909  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:11.795467  7087 raft_consensus.cc:3060] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:11.796495  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:11.798349  7011 raft_consensus.cc:1240] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3. Ops: [2.1-2.1]
W20260709 12:27:11.798581  7130 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.685933  7160 rpcz_store.cc:276] 0709 12:27:10.379761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.384337 (+  4576us) service_pool.cc:224] Handling call
0709 12:27:10.451727 (+ 67390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:10.862055 (+410328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:10.886051 (+ 23996us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:10.990875 (+104824us) log.cc:844] Serialized 26 byte log entry
0709 12:27:11.211168 (+220293us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:11.620714 (+409546us) log.cc:844] Serialized 14 byte log entry
0709 12:27:11.667036 (+ 46322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:11.671831 (+  4795us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:11.671895 (+    64us) raft_consensus.cc:1685] finished
0709 12:27:11.671911 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:11.672044 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4957,"prepare.queue_time_us":451932,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":48309,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":16338,"thread_start_us":870812,"threads_started":3,"wal-append.queue_time_us":247333}
I20260709 12:27:11.800230  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:11.801596  7237 raft_consensus.cc:1240] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:11.802433  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:11.683039  8313 raft_consensus.cc:515] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:11.802760  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:11.803098  7163 raft_consensus.cc:2468] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:11.803423  7237 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 5.
I20260709 12:27:11.804396  7007 raft_consensus.cc:1275] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:11.804602  8313 leader_election.cc:290] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:11.687608  8195 consensus_queue.cc:237] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:11.805466  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:11.805787  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:11.806349  7237 raft_consensus.cc:2410] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:27:11.806728  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:11.807330  7156 raft_consensus.cc:3060] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:11.807574  7237 raft_consensus.cc:1275] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:27:11.801640  8353 log.cc:927] Time spent T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:27:11.708647  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:11.718393  7234 raft_consensus.cc:1240] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:27:11.717144  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:11.810438  7234 raft_consensus.cc:1275] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:11.810698  7090 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:11.810956  7129 leader_election.cc:304] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:11.811880  7234 raft_consensus.cc:1275] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:11.754688  8347 raft_consensus.cc:515] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:11.812786  8309 raft_consensus.cc:2804] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:11.813161  7238 raft_consensus.cc:2393] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 3: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:11.813308  8309 raft_consensus.cc:697] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 4 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:11.814034  8347 leader_election.cc:290] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:11.814180  8309 consensus_queue.cc:237] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:11.786100  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:11.815639  7084 raft_consensus.cc:2410] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:27:11.765120  7091 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46238 (request call id 266) took 1446 ms (client timeout 1591 ms). Trace:
I20260709 12:27:11.788239  8327 raft_consensus.cc:3060] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:11.816501  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:27:11.816701  7091 rpcz_store.cc:269] 0709 12:27:10.318675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.320993 (+  2318us) service_pool.cc:224] Handling call
0709 12:27:10.452532 (+131539us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:11.764946 (+1312414us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b540070ce54. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:11.765066 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1874315520}
I20260709 12:27:11.817786  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:11.767716  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:11.772259  8325 consensus_queue.cc:1059] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:11.818579  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:11.819120  8325 raft_consensus.cc:3055] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:11.819365  7160 raft_consensus.cc:2393] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 3: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:11.819487  8325 raft_consensus.cc:740] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:11.766364  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:11.820317  8325 consensus_queue.cc:260] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:11.821463  8325 raft_consensus.cc:3060] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:11.772871  8241 consensus_queue.cc:1059] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:11.822229  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:11.822878  7010 raft_consensus.cc:2468] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:27:11.823009  8241 raft_consensus.cc:3055] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:11.823457  8241 raft_consensus.cc:740] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:11.824194  8241 consensus_queue.cc:260] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:11.824681  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:11.825263  8241 raft_consensus.cc:3060] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:11.806355  7163 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:11.771999  8302 consensus_queue.cc:1059] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:11.826617  8302 raft_consensus.cc:3055] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:11.826943  8302 raft_consensus.cc:740] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:11.827708  8302 consensus_queue.cc:260] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:11.570873  7082 rpcz_store.cc:276] 0709 12:27:10.327667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.997583 (+669916us) service_pool.cc:224] Handling call
0709 12:27:10.997992 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:10.998506 (+   514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:10.998553 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:10.999136 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 12:27:11.225040 (+225904us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:11.226620 (+  1580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:11.226695 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:11.517490 (+290795us) raft_consensus.cc:1685] finished
0709 12:27:11.521509 (+  4019us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:11.533473 (+ 11964us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4835,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":20328,"thread_start_us":200037,"threads_started":1,"wal-append.queue_time_us":222239}
I20260709 12:27:11.712806  8297 raft_consensus.cc:3060] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:11.780292  8199 raft_consensus.cc:3055] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:11.828956  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:11.829468  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:11.829609  7014 raft_consensus.cc:2468] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:11.829824  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:11.828982  8199 raft_consensus.cc:740] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:11.830639  7235 raft_consensus.cc:2393] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 5: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:11.831024  7012 raft_consensus.cc:1240] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:11.831233  8199 consensus_queue.cc:260] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:11.817833  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:11.774142  7055 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:11.832923  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:11.833768  8301 raft_consensus.cc:2804] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:27:11.832983  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 58942.6us
I20260709 12:27:11.834152  8301 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.834530  8301 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:11.834893  7009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 291) took 1189 ms. Trace:
I20260709 12:27:11.835338  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:11.835294  7009 rpcz_store.cc:276] 0709 12:27:10.645215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.651696 (+  6481us) service_pool.cc:224] Handling call
0709 12:27:10.720687 (+ 68991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:11.780792 (+1060105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:11.834665 (+ 53873us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b540013bfd4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:11.834837 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2246874368}
I20260709 12:27:11.837391  8133 consensus_queue.cc:1048] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:11.838507  8297 raft_consensus.cc:515] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:11.838783  8133 consensus_queue.cc:1048] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:11.839345  7083 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46238 (request call id 273) took 1517 ms (client timeout 1785 ms). Trace:
W20260709 12:27:11.839780  7083 rpcz_store.cc:269] 0709 12:27:10.322186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.826179 (+503993us) service_pool.cc:224] Handling call
0709 12:27:11.839148 (+1012969us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b540032e954. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:11.839289 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1579697536}
I20260709 12:27:11.840245  7128 leader_election.cc:304] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:11.841189  7943 raft_consensus.cc:2804] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:11.841580  7943 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:11.842262  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:11.842891  7235 raft_consensus.cc:3060] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:11.843182  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:27:11.774951  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.843731  7089 raft_consensus.cc:3060] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:11.845333  7013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34216 (request call id 331) took 1102 ms. Trace:
I20260709 12:27:11.845716  7013 rpcz_store.cc:276] 0709 12:27:10.743350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.006595 (+263245us) service_pool.cc:224] Handling call
0709 12:27:11.845157 (+838562us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54004533d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:11.845282 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220128000}
I20260709 12:27:11.847846  7236 raft_consensus.cc:1275] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:11.847857  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:11.849356  8280 raft_consensus.cc:3060] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:11.849397  7239 raft_consensus.cc:1275] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:11.850455  7086 raft_consensus.cc:1275] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:11.850641  8302 raft_consensus.cc:3060] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:11.848392  7083 raft_consensus.cc:1240] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: [1.1-2.2]
I20260709 12:27:11.832489  8199 raft_consensus.cc:3060] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:11.844342  8357 log.cc:927] Time spent T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.170s	user 0.000s	sys 0.002s
I20260709 12:27:11.834163  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:11.853888  7943 raft_consensus.cc:3060] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:11.854509  7091 raft_consensus.cc:2468] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 5.
I20260709 12:27:11.845357  7131 leader_election.cc:304] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:11.853438  7083 raft_consensus.cc:1217] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1]   Dedup: 1.1->[]
I20260709 12:27:11.865671  6980 leader_election.cc:304] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:11.866717  7205 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:11.870368  7091 raft_consensus.cc:1240] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:11.875768  7090 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 6.
I20260709 12:27:11.860175  7131 leader_election.cc:304] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:11.879508  7090 raft_consensus.cc:1240] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:11.887215  7013 raft_consensus.cc:1275] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:11.724263  7054 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:11.866806  7202 leader_election.cc:304] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:11.891284  7203 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
W20260709 12:27:11.888728  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 164520us
I20260709 12:27:11.894573  7670 raft_consensus.cc:2804] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:11.894984  7670 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:11.895364  7670 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:11.895707  7129 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.895287  7203 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:11.896493  7203 leader_election.cc:304] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:11.897487  7131 leader_election.cc:304] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:11.898965  7205 leader_election.cc:304] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:11.899789  7131 leader_election.cc:304] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:11.899994  7089 raft_consensus.cc:2468] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:27:11.906383  7163 raft_consensus.cc:2468] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 5.
I20260709 12:27:11.740396  7008 raft_consensus.cc:1275] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:11.911906  7054 leader_election.cc:400] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Vote denied by peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921) with higher term. Message: Invalid argument: T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 2. Current term is 3.
W20260709 12:27:11.912271  7088 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.006s	sys 0.006s
I20260709 12:27:11.925377  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:11.949820  7202 leader_election.cc:304] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:11.950037  7129 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:11.950484  7164 raft_consensus.cc:2468] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:11.950733  7203 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:11.853825  7082 raft_consensus.cc:1275] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:27:11.951475  7088 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.006s	sys 0.007s
I20260709 12:27:11.949898  7054 leader_election.cc:403] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:27:11.861174  7083 raft_consensus.cc:1240] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:27:11.922168  7163 raft_consensus.cc:1275] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:27:11.956187  7163 pending_rounds.cc:85] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b: Aborting all ops after (but not including) 1
I20260709 12:27:11.956398  7163 pending_rounds.cc:107] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:27:11.956636  7163 raft_consensus.cc:2889] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:11.958599  7091 raft_consensus.cc:1240] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:11.895080  8196 raft_consensus.cc:2804] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:11.894151  8313 raft_consensus.cc:2804] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:11.909641  8300 raft_consensus.cc:2804] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:11.910660  8213 raft_consensus.cc:2804] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:11.954968  7670 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:11.794008  7231 raft_consensus.cc:2468] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 5.
I20260709 12:27:11.911154  8261 raft_consensus.cc:2749] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:11.910985  8133 raft_consensus.cc:2749] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:11.924721  8282 raft_consensus.cc:2804] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:11.911604  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:11.910135  8160 raft_consensus.cc:2749] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:11.925096  8140 raft_consensus.cc:2804] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:11.997820  7091 raft_consensus.cc:1275] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:11.953827  8346 raft_consensus.cc:3060] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:11.895298  8135 consensus_queue.cc:1059] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 12:27:11.956807  7007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 339) took 1180 ms. Trace:
I20260709 12:27:11.896391  8210 consensus_queue.cc:1059] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:27:11.910185  8111 consensus_queue.cc:1048] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 12:27:12.002911  7163 raft_consensus.cc:1275] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:27:11.999359  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:12.008050  7164 raft_consensus.cc:3060] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:11.970592  7086 raft_consensus.cc:1240] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:27:11.920886  8347 consensus_queue.cc:1048] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:27:11.969007  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:11.977566  8196 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.974622  8313 raft_consensus.cc:493] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.024963  7670 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:12.025646  8216 raft_consensus.cc:2749] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:12.021809  8299 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.962010  8316 consensus_queue.cc:1059] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
W20260709 12:27:12.028792  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 78844.1us
W20260709 12:27:12.046535  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:12.052424  6912 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48276 (request call id 67) took 13327 ms (client timeout 15000 ms). Trace:
I20260709 12:27:11.994364  8213 raft_consensus.cc:493] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:12.057931  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 164074us
F20260709 12:27:12.031226  3873 test_workload.cc:382] Timed out: Timed out waiting for Table Creation
I20260709 12:27:12.010111  8282 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.227929  8282 raft_consensus.cc:3060] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:12.229193  8367 log.cc:927] Time spent T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:27:12.079885  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
W20260709 12:27:12.232801  8366 log.cc:927] Time spent T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:27:12.233080  7163 raft_consensus.cc:3060] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:12.032305  8133 raft_consensus.cc:2804] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:12.237015  8133 raft_consensus.cc:697] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 4 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:12.238009  8133 consensus_queue.cc:237] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:12.095156  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 201797us
I20260709 12:27:12.242246  7054 leader_election.cc:304] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:12.056125  8160 raft_consensus.cc:2749] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:12.021864  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 101562us
I20260709 12:27:12.244781  7205 leader_election.cc:304] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:12.246124  7205 leader_election.cc:304] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
W20260709 12:27:12.103055  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 153366us
I20260709 12:27:12.060384  8140 raft_consensus.cc:697] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:12.248116  8140 consensus_queue.cc:237] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:12.027464  8271 consensus_queue.cc:1048] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:27:12.081928  8196 raft_consensus.cc:3060] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:12.085825  8313 raft_consensus.cc:3060] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:12.086073  7157 raft_consensus.cc:3060] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:12.107576  7164 raft_consensus.cc:1275] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:12.261173  7055 leader_election.cc:304] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:12.261411  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:12.261801  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:12.262122  7161 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:12.262490  7055 leader_election.cc:304] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:12.263321  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:12.263425  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
W20260709 12:27:12.124845  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 174207us
I20260709 12:27:12.095000  8300 raft_consensus.cc:697] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:12.264050  7164 raft_consensus.cc:2393] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 5: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:12.099669  8213 raft_consensus.cc:3060] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:12.264698  8300 consensus_queue.cc:237] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:12.265187  7203 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:12.266134  7670 raft_consensus.cc:3055] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:12.266534  7670 raft_consensus.cc:740] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
W20260709 12:27:12.090955  6912 rpcz_store.cc:269] 0709 12:26:58.724970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.725931 (+   961us) service_pool.cc:224] Handling call
0709 12:27:12.052334 (+13326403us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:10.192834 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:10.193431 (+   597us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:10.193467 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:27:10.193483 (+    16us) tablet.cc:662] Decoding operations
0709 12:27:10.194020 (+   537us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:10.194074 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:10.194102 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:27:10.194434 (+   332us) tablet.cc:701] Row locks acquired
0709 12:27:10.194454 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:27:10.194594 (+   140us) write_op.cc:270] Start()
0709 12:27:10.194736 (+   142us) write_op.cc:276] Timestamp: P: 1783600030194549 usec, L: 0
0709 12:27:10.194755 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:27:10.297462 (+102707us) log.cc:844] Serialized 1307 byte log entry
0709 12:27:11.308979 (+1011517us) op_driver.cc:464] REPLICATION: finished
0709 12:27:11.671849 (+362870us) write_op.cc:301] APPLY: starting
0709 12:27:11.671940 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:11.672069 (+   129us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:11.672200 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:11.672837 (+   637us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:11.673012 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:27:11.673061 (+    49us) write_op.cc:312] APPLY: finished
0709 12:27:11.673264 (+   203us) log.cc:844] Serialized 34 byte log entry
0709 12:27:11.673424 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:11.673508 (+    84us) write_op.cc:454] Released schema lock
0709 12:27:11.673542 (+    34us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:11.673893 (+   351us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:11.673917 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":233203,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":357578,"apply.run_cpu_time_us":2030,"apply.run_wall_time_us":2030,"num_ops":3,"prepare.queue_time_us":119506,"prepare.run_cpu_time_us":66868,"prepare.run_wall_time_us":268852,"raft.queue_time_us":183971,"raft.run_cpu_time_us":14352,"raft.run_wall_time_us":268392,"replication_time_us":1078721,"thread_start_us":500983,"threads_started":4,"wal-append.queue_time_us":314287}]]}
I20260709 12:27:12.096102  8299 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:12.268565  8374 raft_consensus.cc:2804] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:12.269186  8374 raft_consensus.cc:697] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:12.103837  8297 leader_election.cc:290] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:27:12.270627  6982 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.270097  8374 consensus_queue.cc:237] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:12.125227  7235 raft_consensus.cc:2468] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:12.113165  8330 consensus_queue.cc:1048] T 807e3a465242486abefc80481a598bf9 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
*** Check failure stack trace: ***
*** Aborted at 1783600032 (unix time) try "date -d @1783600032" if you are using GNU date ***
I20260709 12:27:12.153211  7156 raft_consensus.cc:2468] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:12.153824  8378 raft_consensus.cc:3055] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:12.270254  8299 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:12.141829  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:12.298274  8373 consensus_queue.cc:1048] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:27:12.185143  7087 raft_consensus.cc:2468] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:12.298933  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
W20260709 12:27:12.211570  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 259871us
I20260709 12:27:12.299666  8299 consensus_queue.cc:1048] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:12.205567  8363 log.cc:927] Time spent T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 12:27:12.212352  8364 log.cc:927] Time spent T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 12:27:12.203857  8301 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:12.255225  8382 consensus_queue.cc:1059] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:12.263579  8381 raft_consensus.cc:2749] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:12.267249  7670 consensus_queue.cc:260] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:12.131359  6981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.050868  7007 rpcz_store.cc:276] 0709 12:27:10.745633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.711238 (+965605us) service_pool.cc:224] Handling call
0709 12:27:11.752966 (+ 41728us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:11.804825 (+ 51859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:11.884072 (+ 79247us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b54003ee9d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:11.925831 (+ 41759us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117430528}
I20260709 12:27:12.300478  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:12.270892  8379 raft_consensus.cc:2804] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:12.328154  8379 raft_consensus.cc:493] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.328537  8379 raft_consensus.cc:3060] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:12.271903  7055 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
W20260709 12:27:12.272194  7129 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.330892  7129 leader_election.cc:304] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:12.272475  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:12.269997  8372 raft_consensus.cc:2804] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:27:12.156760  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:12.332835  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.335680  7670 raft_consensus.cc:3060] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:12.277871  7202 leader_election.cc:304] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:12.294605  6982 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.340960  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:12.297516  8322 consensus_queue.cc:1059] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:12.298563  7009 raft_consensus.cc:3060] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:12.189119  8362 log.cc:927] Time spent T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:27:12.298442  8316 consensus_queue.cc:1048] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:27:12.346522  8282 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:12.348650  8282 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:12.348860  7232 raft_consensus.cc:1240] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:12.302781  8346 raft_consensus.cc:2749] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:12.341581  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:12.342576  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 64808.4us
I20260709 12:27:12.324215  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:12.329010  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:12.192638  8368 log.cc:927] Time spent T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:27:12.291002  8160 raft_consensus.cc:2804] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:12.349910  7088 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 272) took 2029 ms. Trace:
I20260709 12:27:12.289558  8252 raft_consensus.cc:2749] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:12.350653  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:12.335758  6980 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:12.300807  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:12.350858  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 79043.8us
I20260709 12:27:12.367915  6980 leader_election.cc:304] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:12.363546  7088 rpcz_store.cc:276] 0709 12:27:10.320532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.836686 (+516154us) service_pool.cc:224] Handling call
0709 12:27:10.837032 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:10.837301 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:27:11.175159 (+337858us) log.cc:844] Serialized 14 byte log entry
0709 12:27:12.135459 (+960300us) log.cc:844] Serialized 14 byte log entry
0709 12:27:12.349575 (+214116us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:12.349629 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:12.349668 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.349741 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.349855 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14026,"prepare.queue_time_us":277967,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":97,"raft.queue_time_us":127574,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":3419,"thread_start_us":1473121,"threads_started":5,"wal-append.queue_time_us":772336}
I20260709 12:27:12.289395  8378 raft_consensus.cc:740] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:12.352818  8297 raft_consensus.cc:493] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:12.371583  6980 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:12.372162  6982 leader_election.cc:400] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Vote denied by peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713) with higher term. Message: Invalid argument: T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3.
I20260709 12:27:12.372670  6982 leader_election.cc:403] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:27:12.372823  6980 leader_election.cc:304] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:12.321861  7163 raft_consensus.cc:2468] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:12.314702  8135 raft_consensus.cc:2749] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921) with higher term. Message: Invalid argument: T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 2. Current term is 3.
I20260709 12:27:12.343189  8382 raft_consensus.cc:2804] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:12.359352  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:12.375767  7014 raft_consensus.cc:2393] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 3: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:12.361063  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:12.348740  8372 raft_consensus.cc:697] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:12.365559  7015 raft_consensus.cc:1275] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:27:12.355181  8300 raft_consensus.cc:2804] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:27:12.367933  7055 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.374027  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:12.377832  7015 pending_rounds.cc:85] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6: Aborting all ops after (but not including) 1
I20260709 12:27:12.391849  7163 raft_consensus.cc:2410] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:12.392055  7015 pending_rounds.cc:107] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:27:12.392445  7015 raft_consensus.cc:2889] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:12.393031  7054 leader_election.cc:304] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:12.374725  8377 raft_consensus.cc:2804] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:12.379074  8199 raft_consensus.cc:2749] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:12.379492  8382 raft_consensus.cc:493] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.380898  8371 raft_consensus.cc:2804] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:12.380415  8372 consensus_queue.cc:237] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:12.362413  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:12.407997  7163 raft_consensus.cc:1240] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:27:12.384971  7165 raft_consensus.cc:1240] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:27:12.385294  8378 consensus_queue.cc:260] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:12.357873  8213 raft_consensus.cc:515] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:12.357049  7008 raft_consensus.cc:3060] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:12.384181  7157 raft_consensus.cc:2468] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:12.367020  8381 raft_consensus.cc:493] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:12.376015  8302 raft_consensus.cc:2749] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:12.390918  7089 raft_consensus.cc:1275] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:12.368512  7011 raft_consensus.cc:2410] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:12.403736  7015 raft_consensus.cc:1275] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:12.394584  7054 leader_election.cc:304] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:12.405002  7016 raft_consensus.cc:1275] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:12.403839  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:12.389279  8280 raft_consensus.cc:2749] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:12.412041  7083 raft_consensus.cc:1275] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:12.406036  6982 leader_election.cc:304] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
W20260709 12:27:12.403350  7943 consensus_meta.cc:287] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.003s
I20260709 12:27:12.415738  7163 raft_consensus.cc:1240] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:12.408593  7131 leader_election.cc:304] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:12.375026  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:12.412957  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 158923us
I20260709 12:27:12.390707  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:12.368362  7156 raft_consensus.cc:2468] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:12.375521  8160 raft_consensus.cc:697] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:12.361720  8322 consensus_queue.cc:1048] T afc5926243c0439fb58fe23dcbd604a1 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:27:12.396791  8300 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.388985  7971 raft_consensus.cc:2749] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:12.422267  7163 raft_consensus.cc:1240] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3. Ops: []
W20260709 12:27:12.429247  8327 consensus_meta.cc:287] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
W20260709 12:27:12.420257  8241 consensus_meta.cc:287] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.002s
I20260709 12:27:12.433889  7088 raft_consensus.cc:2468] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:12.431458  8388 raft_consensus.cc:493] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:12.434864  8388 raft_consensus.cc:515] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:12.436065  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:12.414579  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:12.438249  7230 raft_consensus.cc:2393] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 3: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:12.424216  6982 leader_election.cc:304] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:12.425207  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:12.438905  8346 consensus_queue.cc:1048] T aff8d600c9224a3089ef3ccecd0c25fd P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:27:12.440065  7971 raft_consensus.cc:2749] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:12.440090  7082 raft_consensus.cc:1240] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:12.441108  8388 leader_election.cc:290] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:12.440956  8160 consensus_queue.cc:237] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:12.397327  8342 raft_consensus.cc:2749] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713) with higher term. Message: Invalid argument: T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3.
I20260709 12:27:12.427429  7131 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:12.430380  7007 raft_consensus.cc:2368] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2.
I20260709 12:27:12.430193  8370 consensus_queue.cc:1048] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:27:12.427472  7943 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:12.439239  7089 raft_consensus.cc:3060] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:12.405915  8382 raft_consensus.cc:3060] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:12.445199  7203 leader_election.cc:304] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:12.419034  7158 raft_consensus.cc:1240] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:12.455672  8371 raft_consensus.cc:697] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [term 4 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:12.456595  8397 raft_consensus.cc:493] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.399682  8297 raft_consensus.cc:515] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:12.457523  7015 raft_consensus.cc:1275] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:12.459010  7131 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:12.419639  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:12.431480  8300 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:12.428771  8325 raft_consensus.cc:2749] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:12.421214  8391 raft_consensus.cc:2749] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:12.458041  8309 raft_consensus.cc:2749] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:27:12.530359  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 62439.7us
I20260709 12:27:12.447343  8299 raft_consensus.cc:2749] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:12.467540  7157 raft_consensus.cc:1240] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:12.445842  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:12.466542  7159 raft_consensus.cc:2410] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:27:12.467461  8282 raft_consensus.cc:2749] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:12.422863  8381 raft_consensus.cc:515] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:12.528465  8327 consensus_queue.cc:1048] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:27:12.525794  8392 log.cc:927] Time spent T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:27:12.532671  6982 leader_election.cc:304] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:12.460647  8280 consensus_queue.cc:1048] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.107s
I20260709 12:27:12.529157  8371 consensus_queue.cc:237] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:12.544729  8375 consensus_queue.cc:1048] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:12.545204  7234 raft_consensus.cc:1240] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:12.572747  7161 raft_consensus.cc:1275] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:12.589154  8316 raft_consensus.cc:3055] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:12.545315  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:12.545598  8297 leader_election.cc:290] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:12.546241  7235 raft_consensus.cc:1275] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:12.547781  8213 leader_election.cc:290] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:12.550352  7230 raft_consensus.cc:1240] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:27:12.561151  7055 leader_election.cc:304] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:12.591614  8381 leader_election.cc:290] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:12.595184  8299 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:12.599073  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:12.599656  7091 raft_consensus.cc:3060] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:12.602849  7087 raft_consensus.cc:1275] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:12.592271  8381 raft_consensus.cc:2804] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:12.574127  8301 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:12.460096  8302 consensus_queue.cc:1059] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 12:27:12.579989  8199 raft_consensus.cc:2804] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:12.460319  8135 consensus_queue.cc:1048] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.102s
I20260709 12:27:12.572530  8391 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.550420  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
W20260709 12:27:12.576670  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 44160us
W20260709 12:27:12.532200  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 70829.7us
I20260709 12:27:12.631821  7203 leader_election.cc:304] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:12.531605  8388 consensus_queue.cc:1048] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:27:12.558445  8373 raft_consensus.cc:493] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:12.577606  7084 raft_consensus.cc:2393] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 4: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:12.582103  7009 raft_consensus.cc:2468] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:12.575822  8271 raft_consensus.cc:2749] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:12.589596  8316 raft_consensus.cc:740] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:12.604812  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:12.592337  8378 raft_consensus.cc:3060] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:12.460171  8241 consensus_queue.cc:1059] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 12:27:12.595767  8299 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:12.608940  7055 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:12.619817  7091 raft_consensus.cc:2468] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 6.
I20260709 12:27:12.543496  8397 raft_consensus.cc:515] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:12.563994  7089 raft_consensus.cc:2468] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 4.
I20260709 12:27:12.581777  8133 raft_consensus.cc:2749] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:12.595186  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:12.605554  8318 raft_consensus.cc:3055] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:12.618810  7943 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:12.627049  8381 raft_consensus.cc:697] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:12.608148  8325 consensus_queue.cc:1059] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:27:12.630400  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:27:12.708648  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 248198us
I20260709 12:27:12.627302  8370 consensus_queue.cc:1048] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 12:27:12.609606  7971 consensus_queue.cc:1059] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:27:12.722034  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:12.640174  8322 raft_consensus.cc:2804] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:27:12.724524  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 115667us
I20260709 12:27:12.649296  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:12.723613  8318 raft_consensus.cc:740] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:12.635883  8278 consensus_queue.cc:1059] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 12:27:12.717476  8301 raft_consensus.cc:493] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.717409  8302 raft_consensus.cc:3055] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:12.746784  8327 raft_consensus.cc:3060] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
PC: @                0x0 (unknown)
*** SIGABRT (@0x3e800000f21) received by PID 3873 (TID 0x7f2870d5a840) from PID 3873; stack trace: ***
I20260709 12:27:12.747745  7055 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:12.794239  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 46596.3us
W20260709 12:27:12.748507  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 289582us
I20260709 12:27:12.698627  7157 raft_consensus.cc:1240] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:12.799340  7131 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:12.801084  7205 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:12.750612  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 143851us
I20260709 12:27:12.648319  8373 raft_consensus.cc:515] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:12.729924  8377 raft_consensus.cc:697] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:12.634864  8391 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:12.610352  8342 consensus_queue.cc:1059] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.148s
W20260709 12:27:12.745739  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 107482us
I20260709 12:27:12.750000  8404 raft_consensus.cc:3055] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Stepping down as leader of term 2
    @           0x2d4280 __tsan::CallUserSignalHandler() at /apache/dev/git/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1915
I20260709 12:27:12.768422  7235 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:12.775637  7971 raft_consensus.cc:3055] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:12.781212  8408 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.781955  8299 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:12.782754  8313 consensus_meta.cc:287] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 0.526s	user 0.003s	sys 0.013s
    @           0x2d6763 rtl_sigaction() at /apache/dev/git/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:2005
I20260709 12:27:12.771200  8325 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:12.767215  6913 catalog_manager.cc:5697] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 1 to 3, leader changed from e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68) to 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66). New cstate: current_term: 3 leader_uuid: "9e6e5c8ad44447588681b10df7ad79ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } }
I20260709 12:27:12.792918  8302 raft_consensus.cc:740] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:12.782627  7008 raft_consensus.cc:1275] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:27:12.785945  8196 consensus_meta.cc:287] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 0.530s	user 0.001s	sys 0.010s
I20260709 12:27:12.788352  8381 consensus_queue.cc:237] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:12.797863  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:12.810482  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:12.865031  7164 raft_consensus.cc:2468] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:12.865803  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:12.735416  8280 consensus_queue.cc:1048] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:27:12.816354  7205 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:12.720685  8379 raft_consensus.cc:515] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:12.731333  7085 raft_consensus.cc:2468] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:27:12.867101  7055 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:12.847186  8374 raft_consensus.cc:2804] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:12.770597  8322 raft_consensus.cc:697] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:12.771481  8316 consensus_queue.cc:260] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:12.819285  7943 raft_consensus.cc:2804] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:12.905365  7943 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:12.861052  6982 leader_election.cc:304] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:12.858480  6913 catalog_manager.cc:5697] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:12.860375  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 54063us
I20260709 12:27:12.819083  8135 raft_consensus.cc:2749] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:12.872388  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 56119.1us
I20260709 12:27:12.841534  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:12.841058  8404 raft_consensus.cc:740] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:12.878139  8370 raft_consensus.cc:2749] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:12.878206  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:12.878916  8111 consensus_queue.cc:1048] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:12.880599  8412 consensus_queue.cc:1048] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:12.868220  8325 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:12.864112  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:12.885169  8213 raft_consensus.cc:493] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.890084  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:12.891115  7012 raft_consensus.cc:1275] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:12.894080  8379 leader_election.cc:290] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:12.868608  8196 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:12.866930  8402 consensus_queue.cc:1048] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:27:12.895771  8375 consensus_queue.cc:1059] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:12.856845  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:12.897094  7086 raft_consensus.cc:2393] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 3: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:12.897255  8309 raft_consensus.cc:493] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.860466  8313 raft_consensus.cc:515] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:12.897331  8403 log.cc:927] Time spent T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:27:12.899577  8374 raft_consensus.cc:697] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:12.800586  8301 raft_consensus.cc:515] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:12.905912  8318 consensus_queue.cc:260] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:12.853668  7971 raft_consensus.cc:740] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:12.903234  7131 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:12.819568  8407 consensus_queue.cc:1048] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 12:27:13.008733  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 105594us
I20260709 12:27:12.912438  6913 catalog_manager.cc:5697] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 1 to 2, leader changed from 022925662268440c91fff7e8732d7a0b (127.3.200.67) to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:13.011317  8427 raft_consensus.cc:2804] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:13.010854  6913 catalog_manager.cc:5697] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } }
I20260709 12:27:13.012071  8427 raft_consensus.cc:697] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 4 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:13.012809  6913 catalog_manager.cc:5697] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 2, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.013334  8427 consensus_queue.cc:237] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:13.014829  6913 catalog_manager.cc:5697] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 2, leader changed from <none> to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:12.915053  7238 raft_consensus.cc:1240] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:27:12.776109  7161 raft_consensus.cc:2468] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:12.914811  7943 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:12.922580  7158 raft_consensus.cc:1240] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:27:12.936172  7157 raft_consensus.cc:3060] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:12.861088  8408 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:12.994983  8309 raft_consensus.cc:515] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:12.922977  8278 consensus_queue.cc:1048] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:27:12.901160  8377 consensus_queue.cc:237] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:13.021463  6913 catalog_manager.cc:5697] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } }
I20260709 12:27:13.066494  6913 catalog_manager.cc:5697] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } }
W20260709 12:27:13.023710  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 162704us
I20260709 12:27:13.068979  6982 leader_election.cc:304] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:13.070791  6982 leader_election.cc:304] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:13.021288  7233 raft_consensus.cc:1240] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 LEADER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:27:13.026734  7089 raft_consensus.cc:2468] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:12.996023  8413 consensus_queue.cc:1059] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:27:12.976985  8213 raft_consensus.cc:515] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:13.002815  8397 leader_election.cc:290] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:12.954912  8302 consensus_queue.cc:260] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:13.024899  7082 raft_consensus.cc:2393] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 3: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:13.076033  7054 leader_election.cc:400] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Vote denied by peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921) with higher term. Message: Invalid argument: T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2.
I20260709 12:27:13.089362  7054 leader_election.cc:403] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 1 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:13.076604  6913 catalog_manager.cc:5697] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } }
I20260709 12:27:13.015530  7235 raft_consensus.cc:2468] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 6.
W20260709 12:27:13.089536  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 80138.6us
I20260709 12:27:13.093421  7054 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:13.090837  6913 catalog_manager.cc:5697] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66). New cstate: current_term: 1 leader_uuid: "9e6e5c8ad44447588681b10df7ad79ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } }
I20260709 12:27:13.095724  6913 catalog_manager.cc:5697] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:12.986549  8322 consensus_queue.cc:237] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:13.097599  6913 catalog_manager.cc:5697] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 1 to 2, leader changed from 022925662268440c91fff7e8732d7a0b (127.3.200.67) to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 2 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:13.072906  8318 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:13.130299  6913 catalog_manager.cc:5697] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 reported cstate change: term changed from 2 to 4, leader changed from 022925662268440c91fff7e8732d7a0b (127.3.200.67) to e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68). New cstate: current_term: 4 leader_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:13.102725  7090 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 285) took 1237 ms. Trace:
W20260709 12:27:13.134035  6982 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.135298  7055 leader_election.cc:304] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:13.140612  7015 raft_consensus.cc:1275] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:27:13.141070  7015 pending_rounds.cc:85] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6: Aborting all ops after (but not including) 1
I20260709 12:27:13.141305  7015 pending_rounds.cc:107] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:27:13.141593  7015 raft_consensus.cc:2889] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:13.098357  8195 raft_consensus.cc:2749] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:13.122412  8413 raft_consensus.cc:2749] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:13.086014  8388 consensus_queue.cc:1048] T 77b568a9d33646ddab98b1429efa026e P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:27:13.133694  7090 rpcz_store.cc:276] 0709 12:27:11.865225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.899820 (+ 34595us) service_pool.cc:224] Handling call
0709 12:27:11.953244 (+ 53424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:12.356376 (+403132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:12.356408 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:12.356897 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:27:12.603382 (+246485us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:12.603434 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.603521 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:13.102525 (+499004us) raft_consensus.cc:1685] finished
0709 12:27:13.102545 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:13.102668 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":175113,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6771,"thread_start_us":572290,"threads_started":2,"wal-append.queue_time_us":350483}
I20260709 12:27:13.125594  8241 raft_consensus.cc:2749] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election lost for term 1. Reason: Vote denied by peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921) with higher term. Message: Invalid argument: T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2.
I20260709 12:27:13.133782  8302 raft_consensus.cc:3060] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.125608  8405 raft_consensus.cc:2749] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:13.155938  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:13.138217  8299 raft_consensus.cc:2804] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:13.142154  8373 leader_election.cc:290] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:13.142752  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:13.000625  8404 consensus_queue.cc:260] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:13.141446  8398 raft_consensus.cc:2764] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:27:13.141830  8342 raft_consensus.cc:2804] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:27:13.169374  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:13.087149  8375 consensus_queue.cc:1048] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:27:13.176687  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:13.137912  8135 consensus_queue.cc:1048] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:27:13.101580  8374 consensus_queue.cc:237] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:13.201030  8313 leader_election.cc:290] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:13.201939  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:13.202658  7162 raft_consensus.cc:3060] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:13.192785  8416 log.cc:927] Time spent T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 12:27:13.193881  8419 log.cc:927] Time spent T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:27:13.182191  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:13.188611  7161 raft_consensus.cc:3060] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:13.158422  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:13.194675  8325 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:13.160192  8413 raft_consensus.cc:493] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.171343  8282 consensus_queue.cc:1048] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
W20260709 12:27:13.228911  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 126300us
I20260709 12:27:13.188774  8342 raft_consensus.cc:493] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:13.204099  8404 raft_consensus.cc:3060] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:13.233608  7054 leader_election.cc:304] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:13.240999  7012 raft_consensus.cc:2393] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 3: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:13.261502  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:13.249794  8342 raft_consensus.cc:3060] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.274960  8435 raft_consensus.cc:493] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.260519  8405 raft_consensus.cc:2749] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:13.261638  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:13.275728  8435 raft_consensus.cc:515] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:13.287652  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:13.250311  8413 raft_consensus.cc:515] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:13.288779  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:13.261545  8213 leader_election.cc:290] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:13.289495  7971 consensus_queue.cc:260] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:13.302911  7008 raft_consensus.cc:1275] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:27:13.318331  8382 consensus_meta.cc:287] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.852s	user 0.008s	sys 0.004s
W20260709 12:27:13.339564  8423 log.cc:927] Time spent T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 12:27:13.333945  8300 consensus_meta.cc:287] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.770s	user 0.013s	sys 0.000s
I20260709 12:27:13.314529  7012 raft_consensus.cc:2468] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:13.334443  8408 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:13.341346  7971 raft_consensus.cc:3060] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:13.342267  8382 raft_consensus.cc:515] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:13.373536  7157 raft_consensus.cc:2468] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:13.376375  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:13.378911  7162 raft_consensus.cc:2468] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
W20260709 12:27:13.379612  7162 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56794 (request call id 268) took 1537 ms (client timeout 1958 ms). Trace:
I20260709 12:27:13.379827  7232 raft_consensus.cc:1240] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:27:13.349640  8300 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:13.461948  8377 raft_consensus.cc:493] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:13.458441  8398 raft_consensus.cc:493] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.462595  8377 raft_consensus.cc:515] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:13.463438  8365 log.cc:927] Time spent T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 1.312s	user 0.000s	sys 0.008s
I20260709 12:27:13.463019  8398 raft_consensus.cc:515] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:13.455160  8320 raft_consensus.cc:3055] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:13.442802  8280 raft_consensus.cc:3055] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:27:13.459028  8448 log.cc:927] Time spent T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.093s	user 0.000s	sys 0.002s
I20260709 12:27:13.459431  8404 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:13.469139  8401 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.467361  8320 raft_consensus.cc:740] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:13.469399  8280 raft_consensus.cc:740] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
W20260709 12:27:13.385769  7162 rpcz_store.cc:269] 0709 12:27:11.871916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.884013 (+ 12097us) service_pool.cc:224] Handling call
0709 12:27:12.295397 (+411384us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:12.438609 (+143212us) spinlock_profiling.cc:243] Waited 9.22 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efe9c 00007f28750efa5b 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:13.201814 (+763205us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efeee 000000000036eb39 00007f287d1631e0 00007f287d22c0c4 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:13.379545 (+177731us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102960640}
W20260709 12:27:13.485562  8327 consensus_meta.cc:287] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.003s
I20260709 12:27:13.479467  8382 leader_election.cc:290] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:13.485085  8413 leader_election.cc:290] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:13.498817  8199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.021s	sys 0.009s
I20260709 12:27:13.481272  8404 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:13.507747  8398 leader_election.cc:290] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:13.499796  8327 raft_consensus.cc:2749] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:13.505089  8199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.021s	sys 0.009s
I20260709 12:27:13.505213  8441 raft_consensus.cc:493] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.497232  8377 leader_election.cc:290] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:13.509510  8441 raft_consensus.cc:515] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:13.508857  8199 raft_consensus.cc:697] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:13.513981  8435 leader_election.cc:290] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:13.523927  7015 raft_consensus.cc:1275] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:27:13.524369  7015 pending_rounds.cc:85] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6: Aborting all ops after (but not including) 2
I20260709 12:27:13.524648  7015 pending_rounds.cc:107] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:27:13.524899  7015 raft_consensus.cc:2889] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:13.519814  8438 log.cc:927] Time spent T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:27:13.534597  7943 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:13.538306  7161 raft_consensus.cc:2468] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:13.541725  7055 leader_election.cc:304] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
W20260709 12:27:13.542778  8449 log.cc:927] Time spent T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:27:13.544266  8377 raft_consensus.cc:2804] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:13.552973  8396 raft_consensus.cc:493] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:13.513654  8300 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:13.554870  8450 log.cc:927] Time spent T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:27:13.555415  7236 raft_consensus.cc:1275] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:13.488392  8401 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:13.548105  8442 log.cc:927] Time spent T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 12:27:13.540900  8322 raft_consensus.cc:493] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:13.547477  8213 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.555666  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:13.570279  8451 log.cc:927] Time spent T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:27:13.569240  8322 raft_consensus.cc:515] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:13.571563  8401 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:13.517537  8280 consensus_queue.cc:260] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:13.572649  8280 raft_consensus.cc:3060] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:13.572994  8322 leader_election.cc:290] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:13.573932  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:13.574540  7236 raft_consensus.cc:2468] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
    @     0x7f287861c980 (unknown) at ??:0
I20260709 12:27:13.575469  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:13.577088  8213 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:13.579335  8213 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:13.580622  8199 consensus_queue.cc:237] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:13.581429  7129 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:13.582566  8408 consensus_queue.cc:1048] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:13.584520  7236 raft_consensus.cc:1275] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:13.560446  8377 raft_consensus.cc:697] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:13.586210  8401 raft_consensus.cc:2804] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:13.589123  8401 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.589563  8401 raft_consensus.cc:3060] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:13.589236  8377 consensus_queue.cc:237] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:13.586344  8440 log.cc:927] Time spent T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.197s	user 0.001s	sys 0.001s
I20260709 12:27:13.514554  8320 consensus_queue.cc:260] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:13.592697  8320 raft_consensus.cc:3060] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:13.546238  8342 raft_consensus.cc:515] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:13.595645  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:13.598163  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:13.598654  7164 raft_consensus.cc:3060] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:13.588306  8196 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:13.597214  7090 raft_consensus.cc:1275] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:13.596921  7086 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46238 (request call id 287) took 1214 ms. Trace:
I20260709 12:27:13.598347  8397 raft_consensus.cc:493] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.588398  7235 raft_consensus.cc:1275] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:13.564325  7162 raft_consensus.cc:1275] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:13.593237  8411 raft_consensus.cc:3055] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:13.605157  7236 raft_consensus.cc:2393] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 6: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:13.631026  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:13.563844  8396 raft_consensus.cc:515] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:13.655942  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:13.657243  7008 raft_consensus.cc:3060] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:13.615888  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:13.611358  8342 leader_election.cc:290] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:13.626677  8411 raft_consensus.cc:740] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:13.669207  7164 raft_consensus.cc:2468] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 6.
I20260709 12:27:13.624713  8441 leader_election.cc:290] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:13.672128  8369 raft_consensus.cc:493] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:13.673074  8369 raft_consensus.cc:515] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:13.613526  8397 raft_consensus.cc:515] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:13.689414  7008 raft_consensus.cc:2468] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:27:13.691087  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:13.679384  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:13.667253  7159 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:13.607632  7086 rpcz_store.cc:276] 0709 12:27:12.378208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.388891 (+ 10683us) service_pool.cc:224] Handling call
0709 12:27:13.592226 (+1203335us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b540055f5d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:13.592486 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825848192}
I20260709 12:27:13.614082  8408 consensus_queue.cc:1048] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:27:13.663444  7943 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:13.694831  7236 raft_consensus.cc:2393] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 5: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:13.697485  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:13.687207  8369 leader_election.cc:290] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:13.693715  8297 consensus_queue.cc:1048] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:27:13.703231  8404 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:13.698690  8378 consensus_queue.cc:1048] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:27:13.727202  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:13.729048  7131 leader_election.cc:304] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:13.729068  7012 raft_consensus.cc:1240] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:27:13.731930  8439 raft_consensus.cc:2804] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:13.732276  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:13.732622  8439 raft_consensus.cc:493] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:13.733177  8439 raft_consensus.cc:3060] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.733634  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:13.711091  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:13.734377  7012 raft_consensus.cc:2468] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:13.738313  7131 leader_election.cc:304] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:13.745293  7088 raft_consensus.cc:1240] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:27:13.712534  8411 consensus_queue.cc:260] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:13.741416  8297 raft_consensus.cc:2749] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:13.740856  8369 consensus_queue.cc:1048] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
W20260709 12:27:13.874511  7054 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.881011  8397 leader_election.cc:290] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:13.886461  8401 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:13.893090  8411 raft_consensus.cc:3060] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.912920  8327 raft_consensus.cc:493] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:13.913659  8327 raft_consensus.cc:515] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:13.918284  8327 leader_election.cc:290] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:13.915592  8396 leader_election.cc:290] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:13.984697  8397 raft_consensus.cc:493] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.985484  8397 raft_consensus.cc:515] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:14.011556  8398 raft_consensus.cc:493] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.024578  8397 leader_election.cc:290] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:14.041018  8398 raft_consensus.cc:515] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:14.100576  8377 raft_consensus.cc:493] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:14.132827  8401 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:14.168713  8421 log.cc:927] Time spent T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 1.088s	user 0.000s	sys 0.018s
I20260709 12:27:14.169603  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:14.170320  7008 raft_consensus.cc:2468] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:27:14.177863  7008 raft_consensus.cc:1275] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.179581  7008 raft_consensus.cc:1275] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:27:14.149514  8300 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:14.189477  7156 raft_consensus.cc:1240] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:14.190565  7156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56784 (request call id 210) took 1853 ms. Trace:
I20260709 12:27:14.193713  7231 raft_consensus.cc:1240] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:14.194485  7055 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:14.194837  7231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49160 (request call id 249) took 1653 ms. Trace:
I20260709 12:27:14.195417  7231 rpcz_store.cc:276] 0709 12:27:12.541766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.545823 (+  4057us) service_pool.cc:224] Handling call
0709 12:27:12.546078 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.193457 (+1647379us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5400214920. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f287818bdc0 00007f28782161c0 00007f2878217231 00007f2878213d8f 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c
0709 12:27:14.194388 (+   931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.194707 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30482816}
I20260709 12:27:14.202009  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:14.197160  8327 raft_consensus.cc:2804] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:14.205768  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:14.196832  7011 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34216 (request call id 352) took 2378 ms (client timeout 1991 ms). Trace:
I20260709 12:27:14.149250  8377 raft_consensus.cc:515] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:14.183627  8300 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:14.200314  8111 consensus_queue.cc:1048] T 0e1d204ca67b42f5812cea10c0ef8911 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:27:14.211355  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:14.248713  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.249917  6980 leader_election.cc:304] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:14.212178  7008 raft_consensus.cc:3055] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:14.215183  8391 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:14.215456  8398 leader_election.cc:290] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:14.191045  7156 rpcz_store.cc:276] 0709 12:27:12.337421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.432917 (+ 95496us) service_pool.cc:224] Handling call
0709 12:27:14.188854 (+1755937us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:14.189159 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.190167 (+  1008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.190487 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39517440}
I20260709 12:27:14.216828  7009 raft_consensus.cc:3060] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:14.219636  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.222437  7162 raft_consensus.cc:1275] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:14.223702  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:14.264036  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:14.224299  7157 raft_consensus.cc:1275] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:27:14.225406  7161 raft_consensus.cc:1275] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:27:14.181715  8320 consensus_meta.cc:287] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.587s	user 0.012s	sys 0.002s
I20260709 12:27:14.252812  7008 raft_consensus.cc:740] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:14.268096  7203 leader_election.cc:304] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:14.265146  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:14.270669  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:14.271471  7164 raft_consensus.cc:2393] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 3: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:14.260350  8280 raft_consensus.cc:2749] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:14.276144  7203 leader_election.cc:304] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:14.268215  8213 raft_consensus.cc:493] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.230461  8439 raft_consensus.cc:515] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:14.280406  8213 raft_consensus.cc:515] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:14.281948  8439 leader_election.cc:290] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:14.267001  8396 raft_consensus.cc:493] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:14.282575  8213 leader_election.cc:290] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:14.282945  8396 raft_consensus.cc:515] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:14.284143  7161 raft_consensus.cc:1275] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:14.266415  8401 raft_consensus.cc:493] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.268458  8455 raft_consensus.cc:493] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.266011  8398 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.284868  7087 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 295) took 1680 ms. Trace:
I20260709 12:27:14.277760  7008 consensus_queue.cc:260] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:14.255915  7231 raft_consensus.cc:2468] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:27:14.288422  7008 raft_consensus.cc:3060] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:14.259511  7971 consensus_queue.cc:1059] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
W20260709 12:27:14.228921  7011 rpcz_store.cc:269] 0709 12:27:11.818565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.835074 (+ 16509us) service_pool.cc:224] Handling call
0709 12:27:14.196503 (+2361429us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b5400414bd4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:14.196718 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121804544}
I20260709 12:27:14.262892  8199 consensus_queue.cc:1048] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:27:14.277550  8391 raft_consensus.cc:493] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.286701  7087 rpcz_store.cc:276] 0709 12:27:12.604623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.604756 (+   133us) service_pool.cc:224] Handling call
0709 12:27:12.605128 (+   372us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:12.609765 (+  4637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:12.609805 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:12.627150 (+ 17345us) log.cc:844] Serialized 52 byte log entry
0709 12:27:12.901888 (+274738us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b180016d200. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287dfefab1 00007f287dffc281 00007f2875109e07 00007f287df649a9 00007f287512669b 00007f287512493f 00007f2875126c02 00007f2877dae20b 00007f2877db3d23 00007f2877db40d1 00007f28781cfa0f
0709 12:27:13.020607 (+118719us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:13.101169 (+ 80562us) log.cc:844] Serialized 14 byte log entry
0709 12:27:13.122658 (+ 21489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.122736 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:14.281530 (+1158794us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b180016d200. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287dfefab1 00007f287dffc281 00007f28750f52a6 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287dfefab1 00007f287dffc281 00007f28751273f3 00007f28751297c1
0709 12:27:14.281988 (+   458us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b180016d200. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287dfefab1 00007f287dffc281 00007f28751273f3 00007f28751297c1 00007f2875129779 00007f2875129709 00007f28751296d1 00007f28751289cd 0000000000388634 0000000000388479 00007f287510a83a
0709 12:27:14.284654 (+  2666us) raft_consensus.cc:1685] finished
0709 12:27:14.284677 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.284815 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31300,"prepare.queue_time_us":82790,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":46839,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":10023,"spinlock_wait_cycles":19677184,"thread_start_us":189754,"threads_started":2,"wal-append.queue_time_us":488187}
I20260709 12:27:14.273062  7158 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56794 (request call id 279) took 1450 ms. Trace:
I20260709 12:27:14.275177  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:14.284711  8320 raft_consensus.cc:2804] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:14.286242  8327 raft_consensus.cc:697] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:14.302244  7008 raft_consensus.cc:1275] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:27:14.302673  7008 pending_rounds.cc:85] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6: Aborting all ops after (but not including) 1
I20260709 12:27:14.302892  7008 pending_rounds.cc:107] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:27:14.303108  7008 raft_consensus.cc:2889] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:14.304016  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:14.290624  8280 raft_consensus.cc:493] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:14.297137  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:14.305045  8280 raft_consensus.cc:515] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:14.306170  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:14.307307  8280 leader_election.cc:290] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:14.307682  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:14.291577  8455 raft_consensus.cc:515] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:14.311810  8455 leader_election.cc:290] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:14.296334  7158 rpcz_store.cc:276] 0709 12:27:12.822102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.122002 (+299900us) service_pool.cc:224] Handling call
0709 12:27:13.420326 (+298324us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:13.986270 (+565944us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efe9c 00007f28750efa5b 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:13.986510 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.986731 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:13.987054 (+   323us) log.cc:844] Serialized 14 byte log entry
0709 12:27:14.230255 (+243201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.247558 (+ 17303us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:14.259170 (+ 11612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.262618 (+  3448us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.272016 (+  9398us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":175,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":2104,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":14704,"spinlock_wait_cycles":11203584,"thread_start_us":151234,"threads_started":1,"wal-append.queue_time_us":175631}
I20260709 12:27:14.292884  8213 raft_consensus.cc:2804] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:14.297369  8391 raft_consensus.cc:515] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:14.315768  8327 consensus_queue.cc:237] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:14.316866  8301 leader_election.cc:290] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:14.316942  8391 leader_election.cc:290] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:14.318616  7008 raft_consensus.cc:2393] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 2: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:14.320132  8379 raft_consensus.cc:3055] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:14.320608  8379 raft_consensus.cc:740] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:14.321405  8379 consensus_queue.cc:260] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:14.322512  8379 raft_consensus.cc:3060] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:14.324841  8396 leader_election.cc:290] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:14.289194  8401 raft_consensus.cc:515] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:14.327487  7054 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.328702  7156 raft_consensus.cc:2468] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
W20260709 12:27:14.329506  7054 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.200.65:34921 timed out after 1.883s (SENT) [suppressed 11 similar messages]
I20260709 12:27:14.275421  8322 consensus_queue.cc:1059] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 12:27:14.332984  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 137305us
I20260709 12:27:14.346666  8213 raft_consensus.cc:697] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:14.347477  8320 raft_consensus.cc:697] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:14.348002  8213 consensus_queue.cc:237] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:14.348459  8320 consensus_queue.cc:237] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:14.351986  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 65402.7us
I20260709 12:27:14.291795  8398 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:14.373211  7057 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.363523  7157 raft_consensus.cc:1240] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:27:14.385896  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:14.387434  7157 raft_consensus.cc:1240] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 1. Current term is 2. Ops: []
W20260709 12:27:14.389250  7159 consensus_meta.cc:287] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 0.688s	user 0.009s	sys 0.003s
I20260709 12:27:14.389783  7159 raft_consensus.cc:2468] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 6.
W20260709 12:27:14.390297  7159 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56782 (request call id 196) took 1796 ms (client timeout 1791 ms). Trace:
I20260709 12:27:14.390695  8484 raft_consensus.cc:3055] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:14.391177  8484 raft_consensus.cc:740] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:14.392112  8484 consensus_queue.cc:260] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:14.393442  8484 raft_consensus.cc:3060] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:14.394080  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:14.394776  7161 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:14.396889  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:14.397655  7162 raft_consensus.cc:2468] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:14.399685  7055 leader_election.cc:304] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
W20260709 12:27:14.405241  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 51512.7us
I20260709 12:27:14.363020  8401 leader_election.cc:290] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:14.400019  7009 raft_consensus.cc:1275] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:14.406941  8381 raft_consensus.cc:2804] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:27:14.416815  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 87361.1us
I20260709 12:27:14.407634  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:14.390775  7159 rpcz_store.cc:269] 0709 12:27:12.593854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.601798 (+  7944us) service_pool.cc:224] Handling call
0709 12:27:13.615712 (+1013914us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efe9c 00007f28750efa5b 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:14.390236 (+774524us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37869952}
I20260709 12:27:14.420095  8381 raft_consensus.cc:493] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.426810  8377 leader_election.cc:290] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:14.429529  7162 raft_consensus.cc:2468] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:14.429090  7009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 326) took 1600 ms. Trace:
I20260709 12:27:14.436087  7157 raft_consensus.cc:1275] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:14.431252  8455 raft_consensus.cc:493] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.431841  8199 raft_consensus.cc:493] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.430380  8320 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
    @     0x7f2871a1ae87 gsignal at ??:0
I20260709 12:27:14.436622  7971 raft_consensus.cc:493] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.442497  8381 raft_consensus.cc:3060] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:14.453078  8487 log.cc:927] Time spent T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:27:14.454574  7232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 179) took 1651 ms. Trace:
I20260709 12:27:14.418749  8482 consensus_queue.cc:1048] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:27:14.422376  8481 consensus_queue.cc:1048] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:27:14.457908  7009 rpcz_store.cc:276] 0709 12:27:12.827596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.833428 (+  5832us) service_pool.cc:224] Handling call
0709 12:27:14.216472 (+1383044us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b58001b0698. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:14.216695 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.416820 (+200125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.427456 (+ 10636us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10481536}
I20260709 12:27:14.466248  8441 raft_consensus.cc:493] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:14.466740  8377 raft_consensus.cc:493] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:14.467605  8309 leader_election.cc:290] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:14.444244  8322 consensus_queue.cc:1048] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:27:14.469854  7055 leader_election.cc:304] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:14.470921  8280 raft_consensus.cc:3055] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:14.473346  8316 raft_consensus.cc:3060] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:14.473443  8299 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:14.474531  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:14.474931  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:14.477586  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:14.478402  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:27:14.479158  7202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.479712  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:14.480834  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:14.481853  7128 leader_election.cc:304] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:14.441861  8342 raft_consensus.cc:493] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:14.429829  8213 consensus_queue.cc:1048] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260709 12:27:14.493808  8479 log.cc:927] Time spent T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:27:14.492825  8396 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:14.495714  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:14.501253  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:14.495149  8320 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:14.494102  8455 raft_consensus.cc:515] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:14.503109  8327 raft_consensus.cc:493] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.539316  7085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 297) took 1285 ms. Trace:
I20260709 12:27:14.543499  8327 raft_consensus.cc:515] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:14.519218  7084 raft_consensus.cc:3060] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:14.543642  7085 rpcz_store.cc:276] 0709 12:27:13.253615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.576950 (+323335us) service_pool.cc:224] Handling call
0709 12:27:13.577230 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:13.577638 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:13.577671 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:13.578135 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:27:13.658006 (+ 79871us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:13.695077 (+ 37071us) log.cc:844] Serialized 14 byte log entry
0709 12:27:13.704363 (+  9286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.707607 (+  3244us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:14.225407 (+517800us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b18000bdc40. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287dfefab1 00007f287dffc281 00007f28751273f3 00007f28751297c1 00007f2875129779 00007f2875129709 00007f28751296d1 00007f28751289cd 0000000000388634 0000000000388479 00007f287510a83a
0709 12:27:14.537354 (+311947us) spinlock_profiling.cc:243] Waited 3.6 ms on lock 0x7b18000bdc40. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287dfefab1 00007f287dffc281 00007f28751273f3 00007f28751297c1 00007f2875129779 00007f2875129709 00007f28751296d1 00007f28751289cd 0000000000388634 0000000000388479 00007f287510a83a
0709 12:27:14.539081 (+  1727us) raft_consensus.cc:1685] finished
0709 12:27:14.539109 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.539253 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14953,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2428,"raft.queue_time_us":2061,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":199,"spinlock_wait_cycles":14214144,"thread_start_us":49939,"threads_started":1,"wal-append.queue_time_us":123661}
I20260709 12:27:14.546061  8327 leader_election.cc:290] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:14.546155  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:14.547394  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:14.514480  6980 leader_election.cc:304] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:14.517647  7236 raft_consensus.cc:2468] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:14.492517  8199 raft_consensus.cc:515] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:14.510273  8280 raft_consensus.cc:740] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:14.507436  8490 raft_consensus.cc:493] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.513708  8299 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:14.514484  8478 log.cc:927] Time spent T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.077s	user 0.001s	sys 0.001s
I20260709 12:27:14.495402  7971 raft_consensus.cc:515] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:14.508828  8377 raft_consensus.cc:515] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:14.520232  8492 raft_consensus.cc:493] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:14.529148  8485 log.cc:927] Time spent T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:27:14.515882  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:14.530210  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:14.531070  8397 consensus_queue.cc:1048] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:14.532137  8396 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:14.532721  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:14.533416  7086 raft_consensus.cc:2368] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for earlier term 5. Current term is 6.
I20260709 12:27:14.534061  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:14.534400  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:14.535365  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:27:14.538563  8444 log.cc:927] Time spent T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 1.071s	user 0.004s	sys 0.007s
I20260709 12:27:14.513908  8476 raft_consensus.cc:2804] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:14.518922  8484 raft_consensus.cc:493] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:14.554827  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:14.508857  8441 raft_consensus.cc:515] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:14.518778  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:14.539539  8389 log.cc:927] Time spent T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 1.997s	user 0.010s	sys 0.013s
W20260709 12:27:14.559470  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 60756.5us
I20260709 12:27:14.525766  8401 raft_consensus.cc:2749] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:14.561349  8498 consensus_queue.cc:1059] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:14.500782  7232 rpcz_store.cc:276] 0709 12:27:12.802810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.815612 (+ 12802us) service_pool.cc:224] Handling call
0709 12:27:12.868203 (+ 52591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:13.444237 (+576034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.454165 (+1009928us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b5400481f54. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:14.454488 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1167988992}
I20260709 12:27:14.548467  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:14.550073  8398 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:14.555811  7012 raft_consensus.cc:2468] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:14.571902  7164 raft_consensus.cc:2393] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 2: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:14.572535  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:14.635288  7236 raft_consensus.cc:2393] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 6: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:14.525020  8342 raft_consensus.cc:515] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:14.576138  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:14.578015  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:14.581575  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:14.583703  8377 leader_election.cc:290] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:14.586542  7015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 360) took 1441 ms. Trace:
I20260709 12:27:14.588385  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:14.589764  8199 leader_election.cc:290] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:14.590164  7971 leader_election.cc:290] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:14.569897  8492 raft_consensus.cc:515] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:14.574718  7083 raft_consensus.cc:2468] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:14.594149  7055 leader_election.cc:304] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:14.580298  8396 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:14.564715  8494 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.631305  7090 raft_consensus.cc:2468] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:14.593473  8320 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:14.633209  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:14.634078  7012 raft_consensus.cc:1240] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:14.593375  8476 raft_consensus.cc:493] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.560443  8490 raft_consensus.cc:515] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:14.597756  8347 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
W20260709 12:27:14.643616  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 129184us
W20260709 12:27:14.635542  8372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.857s	user 0.025s	sys 0.024s
I20260709 12:27:14.653024  7015 rpcz_store.cc:276] 0709 12:27:13.145848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.153854 (+  8006us) service_pool.cc:224] Handling call
0709 12:27:13.154160 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.525335 (+371175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.586294 (+1060959us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54002f94d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:14.586481 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":849459072}
I20260709 12:27:14.612694  8484 raft_consensus.cc:515] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:14.600119  8280 consensus_queue.cc:260] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:14.653164  8398 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:15.008119  8499 log.cc:927] Time spent T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 12:27:14.630564  7162 raft_consensus.cc:2468] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:15.009778  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:14.683939  7163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56782 (request call id 194) took 2288 ms. Trace:
I20260709 12:27:14.751420  7016 raft_consensus.cc:1275] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:27:15.012048  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 418004us
W20260709 12:27:14.854130  6979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:15.015308  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 260139us
I20260709 12:27:15.007329  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:15.013037  7055 leader_election.cc:304] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:15.019174  7236 raft_consensus.cc:2468] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
W20260709 12:27:15.038527  7089 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46238 (request call id 292) took 2201 ms (client timeout 1690 ms). Trace:
W20260709 12:27:15.038583  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:15.038976  7089 rpcz_store.cc:269] 0709 12:27:12.811922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.865554 (+ 53632us) service_pool.cc:224] Handling call
0709 12:27:15.013595 (+2148041us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400474ad4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:15.013689 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368498560}
W20260709 12:27:15.039834  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:15.040330  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.723181  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:14.794220  7057 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:14.717795  8409 log.cc:927] Time spent T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 1.943s	user 0.007s	sys 0.012s
I20260709 12:27:15.011678  7163 rpcz_store.cc:276] 0709 12:27:12.369873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.435286 (+ 65413us) service_pool.cc:224] Handling call
0709 12:27:13.148913 (+713627us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:13.149094 (+   181us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:13.181272 (+ 32178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:13.181304 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:13.184563 (+  3259us) log.cc:844] Serialized 26 byte log entry
0709 12:27:13.284264 (+ 99701us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:13.284305 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.380844 (+ 96539us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b540082c654. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:13.380894 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:14.538030 (+1157136us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b4400022b4c. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f287504dc85 00007f287504e6a2 00007f2877dc01db 00007f2877dbbaaf 00007f2877daf86e 00007f2877daebb6 00007f2877dae7d8 00007f2877db8221 00007f2877db81d9 00007f2877db8169
0709 12:27:14.658444 (+120414us) raft_consensus.cc:1685] finished
0709 12:27:14.658475 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.658669 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52315,"raft.queue_time_us":25328,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":4766,"spinlock_wait_cycles":50268672,"thread_start_us":99316,"threads_started":1,"wal-append.queue_time_us":184638}
I20260709 12:27:15.064929  6980 leader_election.cc:304] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
W20260709 12:27:15.066224  6982 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.044661  7232 raft_consensus.cc:2468] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:14.725174  7084 raft_consensus.cc:2468] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:15.007488  8498 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:14.719102  7237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49174 (request call id 286) took 2464 ms. Trace:
W20260709 12:27:14.756134  8411 consensus_meta.cc:287] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 0.862s	user 0.014s	sys 0.001s
I20260709 12:27:15.069954  8498 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:15.069998  7237 rpcz_store.cc:276] 0709 12:27:12.254975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.276845 (+ 21870us) service_pool.cc:224] Handling call
0709 12:27:13.616067 (+1339222us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b5800010298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efe9c 00007f28750efa5b 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:13.616288 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.697096 (+ 80808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:13.698585 (+  1489us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:13.701579 (+  2994us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:13.702506 (+   927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.718809 (+1016303us) spinlock_profiling.cc:243] Waited 76.1 ms on lock 0x7b54006e2b54. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:14.718863 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.719015 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178528768}
I20260709 12:27:15.070832  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:14.772197  8299 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:15.071693  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:14.657433  7007 raft_consensus.cc:2468] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:14.677919  7161 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 6.
I20260709 12:27:15.072897  8299 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:15.073448  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:15.073565  8299 consensus_queue.cc:1048] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:27:14.721436  8496 log.cc:927] Time spent T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:27:15.074251  7161 raft_consensus.cc:2468] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:15.074481  8484 leader_election.cc:290] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:27:15.010349  8372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.232s	user 0.031s	sys 0.030s
I20260709 12:27:15.075240  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:15.013319  8476 raft_consensus.cc:3060] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:15.075862  7011 raft_consensus.cc:2468] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:14.657018  7010 raft_consensus.cc:2468] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
I20260709 12:27:15.079551  7230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 178) took 2277 ms. Trace:
I20260709 12:27:14.697857  7971 raft_consensus.cc:2804] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:14.794610  8377 raft_consensus.cc:493] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:15.082159  7128 leader_election.cc:304] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:15.072064  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:15.068832  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:14.960122  8455 leader_election.cc:290] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:14.696053  8199 raft_consensus.cc:493] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.726240  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:15.074430  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:14.906327  8135 raft_consensus.cc:493] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:15.088865  7971 raft_consensus.cc:493] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:15.008394  8398 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:15.072314  7237 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:15.019433  8379 raft_consensus.cc:2749] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:15.097810  8406 raft_consensus.cc:2804] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:15.122735  8406 raft_consensus.cc:493] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.123190  8406 raft_consensus.cc:3060] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:15.123724  8398 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:15.124085  8379 raft_consensus.cc:493] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.066358  7202 leader_election.cc:304] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:15.127756  8476 raft_consensus.cc:515] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:15.128147  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 61904.9us
I20260709 12:27:15.018728  8347 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:15.129129  7202 leader_election.cc:304] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:15.129001  8379 raft_consensus.cc:515] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:15.130486  8347 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:15.130612  7202 leader_election.cc:304] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:15.131028  8379 leader_election.cc:290] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:15.111198  8455 raft_consensus.cc:2804] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:15.132737  8455 raft_consensus.cc:493] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.132874  8476 leader_election.cc:290] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:15.133163  8455 raft_consensus.cc:3060] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:15.134384  7164 raft_consensus.cc:1275] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:15.111481  8342 leader_election.cc:290] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:15.105592  7231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49174 (request call id 300) took 1512 ms. Trace:
I20260709 12:27:15.094888  8327 raft_consensus.cc:2804] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:15.112452  8300 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:15.099493  8377 raft_consensus.cc:515] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:15.085501  8346 raft_consensus.cc:493] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.075917  7161 raft_consensus.cc:2468] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:15.093376  8280 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:15.043887  8494 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:15.120324  7971 raft_consensus.cc:3060] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:15.156644  7014 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.023s	sys 0.043s
I20260709 12:27:15.108395  8199 raft_consensus.cc:515] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:15.176949  8501 log.cc:927] Time spent T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:27:15.177050  8492 leader_election.cc:290] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:15.177646  8252 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.182803  7013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 323) took 2728 ms. Trace:
I20260709 12:27:15.141433  8441 leader_election.cc:290] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:27:15.183212  7014 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.027s	sys 0.044s
I20260709 12:27:15.142453  8396 raft_consensus.cc:2749] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:15.120443  8135 raft_consensus.cc:515] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:15.144789  8506 raft_consensus.cc:493] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.123210  8278 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.131050  8347 raft_consensus.cc:2804] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:15.123785  8498 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:15.144152  8320 raft_consensus.cc:2804] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:27:15.217922  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 204768us
I20260709 12:27:15.144083  8327 raft_consensus.cc:493] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.079936  7230 rpcz_store.cc:276] 0709 12:27:12.802387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.816370 (+ 13983us) service_pool.cc:224] Handling call
0709 12:27:12.888737 (+ 72367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:13.145267 (+256530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:13.149830 (+  4563us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:13.158129 (+  8299us) log.cc:844] Serialized 26 byte log entry
0709 12:27:13.286838 (+128709us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:13.286906 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.079180 (+1792274us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54006e3554. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:15.079233 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:15.079281 (+    48us) raft_consensus.cc:1685] finished
0709 12:27:15.079293 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:15.079499 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":8505,"spinlock_wait_cycles":545814912,"thread_start_us":128231,"threads_started":1,"wal-append.queue_time_us":193790,"wal-append.run_cpu_time_us":1947,"wal-append.run_wall_time_us":1039794}
W20260709 12:27:15.234830  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 221860us
W20260709 12:27:15.227789  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.229687  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:15.232769  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:15.201658  7013 rpcz_store.cc:276] 0709 12:27:12.445059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.445481 (+   422us) service_pool.cc:224] Handling call
0709 12:27:12.445774 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:12.446096 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:12.446123 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:12.457649 (+ 11526us) log.cc:844] Serialized 26 byte log entry
0709 12:27:12.633634 (+175985us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:12.633676 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.634038 (+   362us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:14.717222 (+2083184us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b4400022b4c. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f287504dc85 00007f287504e6a2 00007f2877dc01db 00007f2877dbbaaf 00007f2877daf86e 00007f2877daebb6 00007f2877dae7d8 00007f2877db8221 00007f2877db81d9 00007f2877db8169
0709 12:27:15.144431 (+427209us) raft_consensus.cc:1685] finished
0709 12:27:15.144453 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:15.173520 (+ 29067us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2906,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":7963,"spinlock_wait_cycles":91268864,"thread_start_us":75389,"threads_started":1,"wal-append.queue_time_us":182290}
W20260709 12:27:15.225800  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 160962us
I20260709 12:27:15.295889  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:15.237716  7131 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:15.180151  8346 raft_consensus.cc:515] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:15.227248  8506 raft_consensus.cc:515] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:15.238636  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:15.309201  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 71556.3us
I20260709 12:27:15.247241  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:15.226294  8347 raft_consensus.cc:493] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:15.240123  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:15.309970  7131 leader_election.cc:304] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:15.238874  8327 raft_consensus.cc:3060] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:15.298043  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:15.310457  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:15.311240  7164 raft_consensus.cc:2410] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 for term 4 because replica has last-logged OpId of term: 2 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:27:15.234443  8507 raft_consensus.cc:493] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:15.324803  8507 raft_consensus.cc:515] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:15.327028  8199 leader_election.cc:290] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:15.311276  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:15.328159  7013 raft_consensus.cc:2410] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for term 5 because replica has last-logged OpId of term: 2 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:27:15.219703  8252 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:15.331331  8252 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:15.308225  8441 consensus_queue.cc:1059] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:27:15.332873  8441 raft_consensus.cc:3055] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:15.333204  8441 raft_consensus.cc:740] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:15.334046  8441 consensus_queue.cc:260] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:15.335176  8441 raft_consensus.cc:3060] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:15.337389  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:15.337991  7164 raft_consensus.cc:3060] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:15.234575  8278 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:15.241930  8320 raft_consensus.cc:697] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:15.263224  8503 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:15.318655  8271 raft_consensus.cc:2749] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:15.319380  8397 raft_consensus.cc:2749] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:15.317812  7131 leader_election.cc:400] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Vote denied by peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713) with higher term. Message: Invalid argument: T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for earlier term 5. Current term is 6.
I20260709 12:27:15.356930  7131 leader_election.cc:403] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:27:15.142446  7231 rpcz_store.cc:276] 0709 12:27:13.593082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.332526 (+739444us) service_pool.cc:224] Handling call
0709 12:27:14.372605 (+ 40079us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:14.412193 (+ 39588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.413178 (+   985us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:14.440745 (+ 27567us) log.cc:844] Serialized 26 byte log entry
0709 12:27:14.517249 (+ 76504us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:14.524633 (+  7384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.527354 (+  2721us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:15.082371 (+555017us) raft_consensus.cc:1685] finished
0709 12:27:15.085350 (+  2979us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:15.099274 (+ 13924us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37920,"raft.queue_time_us":37074,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":5076,"thread_start_us":54468,"threads_started":1,"wal-append.queue_time_us":111238}
I20260709 12:27:15.321866  8512 consensus_queue.cc:1048] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:15.322059  8406 raft_consensus.cc:515] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:15.323002  8347 raft_consensus.cc:3060] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:15.327068  8507 leader_election.cc:290] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:15.317775  8494 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:15.310292  7015 raft_consensus.cc:2468] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
W20260709 12:27:15.302929  8479 log.cc:927] Time spent T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:27:15.347620  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:15.372843  7087 raft_consensus.cc:2410] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:15.347806  7054 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:15.363375  7164 raft_consensus.cc:2468] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
W20260709 12:27:15.364277  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 46661.9us
I20260709 12:27:15.374471  7131 leader_election.cc:304] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:15.375047  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:15.376171  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:15.376381  7131 leader_election.cc:304] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
W20260709 12:27:15.379462  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 237472us
I20260709 12:27:15.380105  7054 leader_election.cc:304] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:15.380628  7131 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:15.381263  7054 leader_election.cc:304] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:15.355695  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:15.391498  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:15.417439  8494 raft_consensus.cc:493] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
W20260709 12:27:15.376180  8316 consensus_meta.cc:287] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.862s	user 0.011s	sys 0.000s
I20260709 12:27:15.501829  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:15.372277  8401 raft_consensus.cc:2749] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713) with higher term. Message: Invalid argument: T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for earlier term 5. Current term is 6.
I20260709 12:27:15.506266  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:15.507138  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:15.372275  8475 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.005s	sys 0.016s
I20260709 12:27:15.511126  7164 raft_consensus.cc:2468] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:15.376242  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:15.383651  8252 raft_consensus.cc:2804] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:27:15.519738  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 138541us
I20260709 12:27:15.521169  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:15.528630  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:15.511650  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.502364  7158 raft_consensus.cc:1275] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:27:15.515797  8475 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.005s	sys 0.017s
I20260709 12:27:15.509680  7010 raft_consensus.cc:2393] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 4: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:15.542526  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:15.543948  7164 raft_consensus.cc:1275] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:15.503427  8378 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:15.511219  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:15.656816  7129 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.003s	sys 0.011s
I20260709 12:27:15.543051  8401 raft_consensus.cc:2804] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:15.518523  8455 raft_consensus.cc:515] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:15.355887  8503 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:15.694201  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:15.525180  8316 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:15.506000  8379 raft_consensus.cc:2804] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:15.515313  8493 raft_consensus.cc:493] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.542223  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:15.530555  7230 raft_consensus.cc:3060] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:15.532516  8300 raft_consensus.cc:493] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:15.634552  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 459214us
I20260709 12:27:15.648010  8252 raft_consensus.cc:697] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
W20260709 12:27:15.648649  8511 log.cc:927] Time spent T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
W20260709 12:27:15.649299  8508 log.cc:927] Time spent T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
W20260709 12:27:15.653194  8483 log.cc:927] Time spent T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 1.298s	user 0.006s	sys 0.003s
I20260709 12:27:15.654052  8346 leader_election.cc:290] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:27:15.657155  7129 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.003s	sys 0.011s
I20260709 12:27:15.667289  8507 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.521044  8320 consensus_queue.cc:237] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:15.603585  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 77592.2us
W20260709 12:27:15.656316  8381 consensus_meta.cc:287] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 1.154s	user 0.007s	sys 0.003s
I20260709 12:27:15.589768  8417 raft_consensus.cc:2804] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:15.561097  8515 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.561055  8513 raft_consensus.cc:2804] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:27:15.658524  7237 consensus_meta.cc:287] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.003s
I20260709 12:27:15.626714  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:15.658599  8271 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:15.714641  7129 leader_election.cc:304] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:15.513691  8494 raft_consensus.cc:515] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:15.663378  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:15.719959  6980 leader_election.cc:304] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:15.722461  8514 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.730916  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:15.804410  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:15.701597  8379 raft_consensus.cc:493] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.805262  8379 raft_consensus.cc:3060] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:15.758633  8529 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.808817  8529 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:15.762072  8278 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:15.764796  8526 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.764963  8397 raft_consensus.cc:493] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:15.707113  8493 raft_consensus.cc:515] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:15.752380  8507 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:15.755888  8417 raft_consensus.cc:493] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
W20260709 12:27:15.766516  7971 consensus_meta.cc:287] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.000s
I20260709 12:27:15.766644  8515 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:15.759601  8381 raft_consensus.cc:515] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:15.718778  8342 raft_consensus.cc:493] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:15.768147  8502 raft_consensus.cc:3055] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:15.720774  7016 raft_consensus.cc:2393] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 3: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
W20260709 12:27:15.796029  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 81466.6us
I20260709 12:27:15.659263  7670 raft_consensus.cc:493] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:15.718829  8505 raft_consensus.cc:493] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.799588  7014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 357) took 2662 ms. Trace:
I20260709 12:27:15.801424  7085 raft_consensus.cc:2468] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:15.861907  7129 leader_election.cc:304] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:15.865214  7129 leader_election.cc:304] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:15.760780  8512 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.752796  8522 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.706756  8316 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:15.702837  8377 leader_election.cc:290] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:15.697306  8401 raft_consensus.cc:697] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 4 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:15.768949  7161 raft_consensus.cc:1275] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:27:15.812688  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 432135us
W20260709 12:27:15.812918  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 93075.4us
I20260709 12:27:15.771363  8513 raft_consensus.cc:493] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:15.717227  8300 raft_consensus.cc:515] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:15.900131  8300 leader_election.cc:290] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:15.900890  8300 consensus_queue.cc:1048] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:15.752341  8199 consensus_queue.cc:1048] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:27:15.904618  8199 raft_consensus.cc:493] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:15.905233  8199 raft_consensus.cc:515] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:15.830727  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 450413us
W20260709 12:27:15.775811  7233 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49174 (request call id 289) took 2213 ms (client timeout 1690 ms). Trace:
I20260709 12:27:15.812526  8371 raft_consensus.cc:2749] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:15.908227  7233 rpcz_store.cc:269] 0709 12:27:13.545581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.547806 (+  2225us) service_pool.cc:224] Handling call
0709 12:27:15.519899 (+1972093us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b5800010298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:15.759344 (+239445us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3235584}
I20260709 12:27:15.909142  8371 raft_consensus.cc:2749] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:15.910005  8371 raft_consensus.cc:2804] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:15.910054  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:15.910552  8371 raft_consensus.cc:493] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.911077  8371 raft_consensus.cc:3060] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:15.775131  7237 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 6.
I20260709 12:27:15.855298  7670 raft_consensus.cc:515] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:15.912899  7237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 188) took 1455 ms. Trace:
I20260709 12:27:15.913324  7237 rpcz_store.cc:276] 0709 12:27:14.457613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.071413 (+613800us) service_pool.cc:224] Handling call
0709 12:27:15.912834 (+841421us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:15.914166  7670 leader_election.cc:290] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:15.812273  8492 raft_consensus.cc:493] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:15.914340  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:15.914814  8492 raft_consensus.cc:515] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:15.856168  7164 raft_consensus.cc:1240] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:27:15.822062  8406 leader_election.cc:290] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:15.857960  7014 rpcz_store.cc:276] 0709 12:27:13.137044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.137202 (+   158us) service_pool.cc:224] Handling call
0709 12:27:14.461789 (+1324587us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b58001b0698. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:14.462039 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:14.653338 (+191299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.653376 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:14.653796 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 12:27:15.204199 (+550403us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:15.204241 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.639317 (+435076us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54005956d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:15.639393 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:15.799285 (+159892us) raft_consensus.cc:1685] finished
0709 12:27:15.799316 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:15.799507 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":149710,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":48845,"spinlock_wait_cycles":257760768,"thread_start_us":631177,"threads_started":2,"wal-append.queue_time_us":582929}
I20260709 12:27:15.719705  8135 leader_election.cc:290] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:15.911993  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:15.797040  8271 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:15.916534  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:15.917681  7233 raft_consensus.cc:2410] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:15.917949  7164 raft_consensus.cc:2393] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 3: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:15.918823  8271 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:15.837922  8417 raft_consensus.cc:3060] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:15.823163  7157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56794 (request call id 290) took 1285 ms. Trace:
I20260709 12:27:15.921010  8199 leader_election.cc:290] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:15.836163  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:15.922254  7086 raft_consensus.cc:2393] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 3: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:15.887625  8372 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:15.923004  8507 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:15.923353  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:15.923993  7085 raft_consensus.cc:2468] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:15.924893  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:15.925982  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:15.926510  7085 raft_consensus.cc:2468] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
W20260709 12:27:15.927263  8327 consensus_meta.cc:287] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.000s
I20260709 12:27:15.927570  7085 raft_consensus.cc:1240] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:15.927654  8327 raft_consensus.cc:515] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:15.833659  8526 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:15.850163  7971 raft_consensus.cc:515] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:15.835932  8397 raft_consensus.cc:515] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:15.854770  8502 raft_consensus.cc:740] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:15.820782  8498 raft_consensus.cc:2804] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:15.944237  8498 raft_consensus.cc:493] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.930676  8513 raft_consensus.cc:3060] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.923110  8372 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:15.880537  8522 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:15.946532  8372 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:15.835713  8506 leader_election.cc:290] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:15.852751  7156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56782 (request call id 203) took 1516 ms. Trace:
I20260709 12:27:15.947325  7156 rpcz_store.cc:276] 0709 12:27:14.336772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.357050 (+ 20278us) service_pool.cc:224] Handling call
0709 12:27:15.602199 (+1245149us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:15.851102 (+248903us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32638720}
I20260709 12:27:15.947389  8401 consensus_queue.cc:237] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:15.931775  7090 raft_consensus.cc:2368] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 for earlier term 3. Current term is 4.
I20260709 12:27:15.943622  7165 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56794 (request call id 270) took 4070 ms. Trace:
I20260709 12:27:15.949795  7165 rpcz_store.cc:276] 0709 12:27:11.872837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.872979 (+   142us) service_pool.cc:224] Handling call
0709 12:27:12.290042 (+417063us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:12.410284 (+120242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.461464 (+2051180us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b54001a2a54. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:15.943439 (+1481975us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54001a2a50. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782138ad 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:15.943566 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1175570048}
I20260709 12:27:15.833776  8252 consensus_queue.cc:237] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:15.940115  7084 raft_consensus.cc:1275] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:15.921118  7157 rpcz_store.cc:276] 0709 12:27:14.537664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.550496 (+ 12832us) service_pool.cc:224] Handling call
0709 12:27:14.568700 (+ 18204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:14.630005 (+ 61305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.636489 (+  6484us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:14.723370 (+ 86881us) log.cc:844] Serialized 26 byte log entry
0709 12:27:15.142397 (+419027us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:15.152590 (+ 10193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.175704 (+ 23114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:15.792064 (+616360us) raft_consensus.cc:1685] finished
0709 12:27:15.795018 (+  2954us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:15.819394 (+ 24376us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2209,"raft.queue_time_us":12487,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":13512,"thread_start_us":336328,"threads_started":1,"wal-append.queue_time_us":501124}
I20260709 12:27:15.820025  8514 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:15.943684  8397 leader_election.cc:290] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:15.944660  8498 raft_consensus.cc:3060] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:15.946672  8522 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:15.877606  8278 raft_consensus.cc:493] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.874859  8505 raft_consensus.cc:515] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:15.937290  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:27:15.949555  8519 log.cc:927] Time spent T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 12:27:15.941985  7971 leader_election.cc:290] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:15.860003  8342 raft_consensus.cc:515] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:15.946813  7088 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46248 (request call id 236) took 2854 ms. Trace:
I20260709 12:27:16.023694  7088 rpcz_store.cc:276] 0709 12:27:13.092808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.249730 (+156922us) service_pool.cc:224] Handling call
0709 12:27:13.596398 (+346668us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:13.745785 (+149387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.718833 (+1973048us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540055f5d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:15.946595 (+227762us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b540055f5d0. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782138ad 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:15.946722 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1116396672}
I20260709 12:27:15.975875  7202 leader_election.cc:304] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
W20260709 12:27:15.967186  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 208815us
I20260709 12:27:15.950269  7090 raft_consensus.cc:1275] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:27:15.875069  8512 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:16.029044  7054 leader_election.cc:304] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:16.031603  7054 leader_election.cc:304] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:16.034794  7234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 194) took 1558 ms. Trace:
W20260709 12:27:16.036722  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 171580us
W20260709 12:27:16.037747  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 149499us
I20260709 12:27:16.040539  7129 leader_election.cc:304] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:16.041441  8506 raft_consensus.cc:2749] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:16.048282  7129 leader_election.cc:304] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:16.050153  8534 raft_consensus.cc:2749] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:16.051322  7129 leader_election.cc:304] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:16.052762  8534 raft_consensus.cc:2749] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:16.053583  8534 raft_consensus.cc:493] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.054113  8534 raft_consensus.cc:515] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:16.055374  7239 raft_consensus.cc:1275] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:16.056360  8534 leader_election.cc:290] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:16.060487  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:16.061684  7239 raft_consensus.cc:2410] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:16.062892  8516 consensus_queue.cc:1048] T 798483090bd74738a29fe018ce19422f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:16.064039  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:16.064747  7239 raft_consensus.cc:3060] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:27:16.066668  7157 raft_consensus.cc:1240] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:27:16.064738  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 165457us
I20260709 12:27:16.068751  7055 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:16.069610  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:16.070363  7016 raft_consensus.cc:2468] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:27:16.070609  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:16.063285  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 349674us
I20260709 12:27:16.071785  6982 leader_election.cc:304] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:16.071998  7239 raft_consensus.cc:2468] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:16.073194  7971 raft_consensus.cc:2804] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:16.073640  7971 raft_consensus.cc:493] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:16.073730  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:16.074124  7971 raft_consensus.cc:3060] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:16.074317  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:16.074496  7157 raft_consensus.cc:2468] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:16.076951  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:16.076997  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:16.077919  7231 raft_consensus.cc:2468] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:16.080924  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:15.933296  7230 raft_consensus.cc:2468] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:16.079593  7088 raft_consensus.cc:1275] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:27:16.082636  6980 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:15.995815  8455 leader_election.cc:290] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:27:16.083861  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 108123us
I20260709 12:27:16.086131  6982 leader_election.cc:304] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
W20260709 12:27:16.028812  8525 log.cc:927] Time spent T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 12:27:16.126621  7129 leader_election.cc:304] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:16.031201  8521 log.cc:927] Time spent T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
W20260709 12:27:16.022338  8261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.009s	sys 0.011s
I20260709 12:27:15.990751  8371 raft_consensus.cc:515] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:16.130318  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 57790.3us
I20260709 12:27:16.069650  7055 leader_election.cc:304] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:16.143782  7129 leader_election.cc:304] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:16.017139  8278 raft_consensus.cc:515] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:16.149214  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 79613.3us
I20260709 12:27:16.176628  7055 leader_election.cc:304] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:15.975685  8502 consensus_queue.cc:260] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:16.129917  8519 log.cc:927] Time spent T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:27:16.204747  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 61057.7us
I20260709 12:27:16.123102  8540 raft_consensus.cc:493] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:16.134792  8261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.010s	sys 0.012s
I20260709 12:27:16.080197  8503 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:27:16.158468  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 72436.5us
W20260709 12:27:16.268186  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 185367us
I20260709 12:27:16.125751  8271 consensus_queue.cc:1048] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.119s
I20260709 12:27:16.166285  8516 raft_consensus.cc:2804] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:16.167392  8541 raft_consensus.cc:2749] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:16.166954  8494 leader_election.cc:290] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:16.169399  8522 raft_consensus.cc:2749] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:16.236919  8507 raft_consensus.cc:2804] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:16.131944  8455 consensus_queue.cc:1059] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.130s
I20260709 12:27:16.172869  8558 raft_consensus.cc:2804] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:27:16.335227  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 249975us
I20260709 12:27:16.327874  7238 raft_consensus.cc:1275] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:16.217308  8213 consensus_queue.cc:1048] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.092s
W20260709 12:27:16.236280  8199 consensus_queue.cc:1175] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "022925662268440c91fff7e8732d7a0b" responder_term: 5 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:16.359338  7236 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49174 (request call id 305) took 2624 ms. Trace:
I20260709 12:27:16.287075  7237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 196) took 1684 ms. Trace:
I20260709 12:27:16.288010  7084 raft_consensus.cc:1275] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:16.308616  8516 raft_consensus.cc:493] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:16.367100  7159 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56794 (request call id 293) took 1817 ms. Trace:
I20260709 12:27:16.367653  8555 raft_consensus.cc:2804] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:16.279855  8381 leader_election.cc:290] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:16.255777  8133 raft_consensus.cc:2804] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:16.379627  8563 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.355341  6982 leader_election.cc:400] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713) with higher term. Message: Invalid argument: T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 for earlier term 3. Current term is 4.
I20260709 12:27:16.286949  8529 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:16.316726  8503 raft_consensus.cc:493] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:27:16.389142  8476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.055s	sys 0.176s
I20260709 12:27:16.389588  7202 leader_election.cc:304] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:16.356325  8507 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:16.149462  8548 consensus_queue.cc:1048] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.258s
I20260709 12:27:16.368435  8558 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.382896  8327 leader_election.cc:290] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:16.262384  8540 raft_consensus.cc:515] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:16.382465  7237 rpcz_store.cc:276] 0709 12:27:14.594972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.915346 (+1320374us) service_pool.cc:224] Handling call
0709 12:27:15.915649 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.915870 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:15.916389 (+   519us) log.cc:844] Serialized 14 byte log entry
0709 12:27:16.134446 (+218057us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:16.148988 (+ 14542us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:16.166349 (+ 17361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.235013 (+ 68664us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.278882 (+ 43869us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61547,"prepare.queue_time_us":115,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":38,"raft.queue_time_us":108393,"raft.run_wall_time_us":30382,"spinlock_wait_cycles":28257024,"thread_start_us":149298,"threads_started":1,"wal-append.queue_time_us":322018}
I20260709 12:27:16.393599  8526 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:27:16.419341  8549 log.cc:927] Time spent T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:27:16.421128  8316 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:16.423913  7086 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46238 (request call id 308) took 1947 ms. Trace:
I20260709 12:27:16.408725  8518 consensus_queue.cc:1048] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:27:16.425166  8555 raft_consensus.cc:697] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:16.398018  8516 raft_consensus.cc:3060] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:16.374728  8271 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:16.466027  8537 log.cc:927] Time spent T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.427s	user 0.001s	sys 0.001s
W20260709 12:27:16.447479  8476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.063s	sys 0.176s
I20260709 12:27:16.388571  7160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56794 (request call id 277) took 3558 ms. Trace:
W20260709 12:27:16.409668  8378 consensus_meta.cc:287] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.747s	user 0.013s	sys 0.000s
I20260709 12:27:16.376171  7236 rpcz_store.cc:276] 0709 12:27:13.734466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.101251 (+1366785us) service_pool.cc:224] Handling call
0709 12:27:15.101694 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:15.102012 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:15.102043 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:15.102537 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:27:15.265125 (+162588us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:15.265172 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.265238 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:16.359014 (+1093776us) raft_consensus.cc:1685] finished
0709 12:27:16.359047 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.359255 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9799,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"thread_start_us":162217,"threads_started":1,"wal-append.queue_time_us":590838}
I20260709 12:27:16.394232  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:16.398590  8347 consensus_meta.cc:287] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 1.023s	user 0.011s	sys 0.002s
W20260709 12:27:16.411768  8379 consensus_meta.cc:287] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.606s	user 0.011s	sys 0.001s
I20260709 12:27:16.035634  7234 rpcz_store.cc:276] 0709 12:27:14.476416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.115086 (+638670us) service_pool.cc:224] Handling call
0709 12:27:15.115478 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.115755 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:15.424154 (+308399us) log.cc:844] Serialized 14 byte log entry
0709 12:27:16.034399 (+610245us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:16.034462 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:16.034506 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.034581 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.034722 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":547898,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":171491,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":7162,"thread_start_us":753136,"threads_started":3,"wal-append.queue_time_us":474080}
I20260709 12:27:16.439633  8564 raft_consensus.cc:2804] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:16.441663  8558 raft_consensus.cc:3060] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:16.397284  7159 rpcz_store.cc:276] 0709 12:27:14.549668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.124928 (+575260us) service_pool.cc:224] Handling call
0709 12:27:15.125261 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:15.125617 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:15.125650 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:15.126103 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 12:27:15.295006 (+168903us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:15.316684 (+ 21678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.316816 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:16.314437 (+997621us) raft_consensus.cc:1685] finished
0709 12:27:16.329001 (+ 14564us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.360841 (+ 31840us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3122,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":134570,"threads_started":1,"wal-append.queue_time_us":463931}
I20260709 12:27:16.439555  8507 raft_consensus.cc:3060] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:16.415186  8133 raft_consensus.cc:493] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
W20260709 12:27:16.448071  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 58574us
I20260709 12:27:16.481950  8378 raft_consensus.cc:2749] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:16.451997  8543 log.cc:927] Time spent T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:27:16.448793  8529 raft_consensus.cc:2804] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:16.430038  8541 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.410606  8494 consensus_queue.cc:1059] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:27:16.430016  7084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 309) took 1059 ms. Trace:
I20260709 12:27:16.427178  6982 leader_election.cc:403] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:16.465942  8271 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:16.448413  8381 raft_consensus.cc:2804] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:16.453444  8327 raft_consensus.cc:2804] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:16.440676  8503 raft_consensus.cc:515] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:16.441910  8562 log.cc:927] Time spent T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:27:16.483175  6981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.492599  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:16.701157  7088 raft_consensus.cc:2468] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 1.
I20260709 12:27:16.458374  7086 rpcz_store.cc:276] 0709 12:27:14.476870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.581255 (+104385us) service_pool.cc:224] Handling call
0709 12:27:16.423679 (+1842424us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540070e254. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:16.423842 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2806314752}
W20260709 12:27:16.490729  7007 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34216 (request call id 369) took 1998 ms (client timeout 1878 ms). Trace:
I20260709 12:27:16.445036  8563 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:16.577986  7232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49174 (request call id 304) took 2856 ms. Trace:
I20260709 12:27:16.688112  8261 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:16.704398  7232 rpcz_store.cc:276] 0709 12:27:13.721917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.099684 (+1377767us) service_pool.cc:224] Handling call
0709 12:27:15.106582 (+  6898us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:15.340813 (+234231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:15.340849 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:15.346359 (+  5510us) log.cc:844] Serialized 26 byte log entry
0709 12:27:15.805244 (+458885us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:15.805567 (+   323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.806397 (+   830us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:16.577709 (+771312us) raft_consensus.cc:1685] finished
0709 12:27:16.577732 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.577919 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5145,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":659042,"threads_started":2,"wal-append.queue_time_us":564559}
I20260709 12:27:16.498493  8133 raft_consensus.cc:3060] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:16.489116  8347 raft_consensus.cc:515] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:16.577466  8560 log.cc:927] Time spent T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:27:16.488577  8379 raft_consensus.cc:515] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:16.564045  8549 log.cc:927] Time spent T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:27:16.638742  8280 consensus_meta.cc:287] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 1.457s	user 0.009s	sys 0.002s
I20260709 12:27:16.499055  8371 leader_election.cc:290] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:16.578428  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:16.497004  8512 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:16.553737  8567 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:16.502285  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:16.563481  7082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 302) took 2088 ms. Trace:
W20260709 12:27:16.653807  8530 log.cc:927] Time spent T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.478s	user 0.001s	sys 0.001s
I20260709 12:27:16.624737  8555 consensus_queue.cc:237] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:16.653409  8565 log.cc:927] Time spent T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
W20260709 12:27:16.675359  7205 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.010s	sys 0.016s
W20260709 12:27:16.750417  7205 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.011s	sys 0.016s
W20260709 12:27:16.750805  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 612605us
I20260709 12:27:16.696192  8541 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:16.751734  7205 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:16.691679  8516 raft_consensus.cc:515] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:16.562616  7054 leader_election.cc:304] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
W20260709 12:27:16.755203  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 192696us
W20260709 12:27:16.668939  8544 log.cc:927] Time spent T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:27:16.669831  8564 raft_consensus.cc:697] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
W20260709 12:27:16.703544  7007 rpcz_store.cc:269] 0709 12:27:14.492104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.532443 (+ 40339us) service_pool.cc:224] Handling call
0709 12:27:16.484081 (+1951638us) spinlock_profiling.cc:243] Waited 76.1 ms on lock 0x7b54003eeed4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:16.488720 (+  4639us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175080704}
W20260709 12:27:16.696944  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 200562us
I20260709 12:27:16.688446  8529 raft_consensus.cc:493] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.768157  8529 raft_consensus.cc:3060] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:16.768599  8503 leader_election.cc:290] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:16.769268  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:16.727941  7082 rpcz_store.cc:276] 0709 12:27:14.475386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.475518 (+   132us) service_pool.cc:224] Handling call
0709 12:27:14.475848 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.677161 (+201313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.684723 (+  7562us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.697833 (+ 13110us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:14.714416 (+ 16583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.563148 (+1848732us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b540070d354. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:16.563216 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.563407 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395409152}
I20260709 12:27:16.770512  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:16.770591  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:16.771145  7082 raft_consensus.cc:2468] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:16.685995  8526 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:16.772704  8526 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:16.775063  8526 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:16.727653  8515 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:16.709219  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:16.779670  7088 raft_consensus.cc:2468] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:16.692910  8493 leader_election.cc:290] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:16.700140  8411 raft_consensus.cc:3060] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:16.697139  8381 raft_consensus.cc:493] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.717747  8563 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:16.702661  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:16.720221  6979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.704150  8327 raft_consensus.cc:697] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:16.726742  7091 raft_consensus.cc:1240] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:16.694356  7084 rpcz_store.cc:276] 0709 12:27:15.370465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.080660 (+710195us) service_pool.cc:224] Handling call
0709 12:27:16.140358 (+ 59698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.393131 (+252773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.426465 (+ 33334us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:16.745342  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:16.729768  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:16.797538  8515 raft_consensus.cc:493] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:16.798167  8515 raft_consensus.cc:515] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:16.694800  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 377043us
I20260709 12:27:16.725759  7230 raft_consensus.cc:1275] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:27:16.762702  7205 leader_election.cc:304] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
W20260709 12:27:16.766435  7971 consensus_meta.cc:287] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 0.692s	user 0.007s	sys 0.004s
I20260709 12:27:16.710402  8261 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:16.782769  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:16.808563  7088 raft_consensus.cc:2468] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:16.794049  7159 raft_consensus.cc:2410] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:27:16.782284  8484 raft_consensus.cc:2749] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:16.795079  8327 consensus_queue.cc:237] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:16.795907  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:16.796118  8503 raft_consensus.cc:493] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:16.796496  8280 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:16.800367  8515 leader_election.cc:290] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:16.807544  7971 raft_consensus.cc:515] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:16.809379  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 46794.5us
I20260709 12:27:16.802297  8381 raft_consensus.cc:3060] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:16.752883  8540 leader_election.cc:290] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:16.835675  7205 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
W20260709 12:27:16.811954  7010 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34210 (request call id 188) took 1583 ms (client timeout 1804 ms). Trace:
I20260709 12:27:16.781838  8568 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.760882  8512 raft_consensus.cc:2804] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:16.855104  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:27:16.813480  8441 consensus_meta.cc:287] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 1.478s	user 0.013s	sys 0.011s
I20260709 12:27:16.812288  8563 raft_consensus.cc:2749] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:16.853773  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:16.855721  7088 raft_consensus.cc:2468] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:16.858925  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:16.858933  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:16.862113  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:16.760687  8567 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:16.852418  8417 consensus_meta.cc:287] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 0.932s	user 0.012s	sys 0.000s
W20260709 12:27:16.869930  8576 log.cc:927] Time spent T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:27:16.871009  7971 leader_election.cc:290] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:16.871358  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:16.871667  7971 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:16.872604  8502 raft_consensus.cc:3060] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:16.872779  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:16.860191  7082 raft_consensus.cc:2393] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 5: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:16.864988  7087 raft_consensus.cc:2410] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:16.894016  7232 raft_consensus.cc:2468] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
W20260709 12:27:16.815145  7202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.865813  7236 raft_consensus.cc:2393] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 3: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:16.839197  8515 raft_consensus.cc:493] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.895808  8515 raft_consensus.cc:515] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:16.873631  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:16.897038  7088 raft_consensus.cc:2393] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 3: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:16.855376  8261 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:16.854569  8512 raft_consensus.cc:493] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:16.720736  7234 raft_consensus.cc:3060] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:27:16.899731  8515 leader_election.cc:290] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:16.836766  8280 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:16.911859  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:16.859948  8566 raft_consensus.cc:2749] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:16.836453  8503 raft_consensus.cc:515] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:16.472152  7160 rpcz_store.cc:276] 0709 12:27:12.821416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.832033 (+ 10617us) service_pool.cc:224] Handling call
0709 12:27:14.575800 (+1743767us) spinlock_profiling.cc:243] Waited 8.7 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efeee 000000000036eb39 00007f287d1631e0 00007f287d22c0c4 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:14.575964 (+   164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:14.576359 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:27:15.020049 (+443690us) log.cc:844] Serialized 14 byte log entry
0709 12:27:15.320486 (+300437us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:15.321139 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 12:27:15.321316 (+   177us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:15.321365 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.321463 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:16.344791 (+1023328us) raft_consensus.cc:1685] finished
0709 12:27:16.368107 (+ 23316us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.380201 (+ 12094us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8616,"prepare.queue_time_us":569733,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":3240,"raft.queue_time_us":20807,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":171,"spinlock_wait_cycles":20008192,"thread_start_us":473343,"threads_started":2,"wal-append.queue_time_us":478877}
I20260709 12:27:17.011636  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:16.872243  7971 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:17.015461  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:17.016886  7055 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.042s	sys 0.088s
    @     0x7f2871a1c7f1 abort at ??:0
    @           0x2da276 abort at /apache/dev/git/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:263
W20260709 12:27:17.341805  6980 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.036s	user 0.028s	sys 0.052s
W20260709 12:27:17.381757  7055 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.204s	user 0.042s	sys 0.088s
W20260709 12:27:17.381825  6980 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.076s	user 0.028s	sys 0.053s
W20260709 12:27:17.382746  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 1.09488e+06us
W20260709 12:27:17.383910  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 1.20733e+06us
W20260709 12:27:16.846839  7010 rpcz_store.cc:269] 0709 12:27:15.228306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.229318 (+  1012us) service_pool.cc:224] Handling call
0709 12:27:16.811733 (+1582415us) spinlock_profiling.cc:243] Waited 67.2 ms on lock 0x7b54003d5254. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:16.811888 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154656640}
I20260709 12:27:17.388790  7055 leader_election.cc:304] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
W20260709 12:27:17.392925  7056 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.089s	user 0.019s	sys 0.054s
W20260709 12:27:17.393601  7056 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.107s	user 0.019s	sys 0.054s
W20260709 12:27:17.401404  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.019063  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:27:17.091030  7089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.035s	sys 0.053s
W20260709 12:27:17.413923  7089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.035s	sys 0.053s
I20260709 12:27:17.404222  6980 leader_election.cc:304] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:17.425657  7130 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.003s	sys 0.007s
W20260709 12:27:17.426182  7130 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.004s	sys 0.008s
W20260709 12:27:17.162899  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 190563us
W20260709 12:27:17.431013  7202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:17.380818  7008 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.003s	sys 0.008s
W20260709 12:27:17.440789  7008 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.003s	sys 0.008s
I20260709 12:27:17.441490  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:17.444758  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:17.445775  7160 raft_consensus.cc:2468] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 4.
I20260709 12:27:17.448601  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:17.451581  7159 raft_consensus.cc:1240] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:27:17.052659  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:17.456143  7011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 346) took 2859 ms. Trace:
I20260709 12:27:17.456871  7011 rpcz_store.cc:276] 0709 12:27:14.596806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.077451 (+480645us) service_pool.cc:224] Handling call
0709 12:27:15.077819 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:15.263911 (+186092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:15.302441 (+ 38530us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:15.355503 (+ 53062us) log.cc:844] Serialized 26 byte log entry
0709 12:27:15.895928 (+540425us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:15.930672 (+ 34744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.455140 (+1524468us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54003f16d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:17.455248 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:17.455359 (+   111us) raft_consensus.cc:1685] finished
0709 12:27:17.455379 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.455811 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13451,"raft.queue_time_us":50703,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":43076,"spinlock_wait_cycles":336205056,"thread_start_us":363597,"threads_started":1,"wal-append.queue_time_us":752749}
I20260709 12:27:17.459693  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:17.461993  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:17.463577  7235 raft_consensus.cc:2393] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 4: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:17.464577  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:17.464913  7087 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46252 (request call id 302) took 2109 ms (client timeout 1843 ms). Trace:
I20260709 12:27:17.465070  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:17.465580  7235 raft_consensus.cc:2393] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 3: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
W20260709 12:27:17.465632  7087 rpcz_store.cc:269] 0709 12:27:15.355044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.804108 (+449064us) service_pool.cc:224] Handling call
0709 12:27:17.464330 (+1660222us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400392bd4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:17.464652 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2427497728}
I20260709 12:27:17.466944  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:17.467552  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
    @     0x7f28747ecd84 google::LogMessage::SendToLog() at ??:0
I20260709 12:27:17.031756  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:16.901988  7237 raft_consensus.cc:2468] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:17.590116  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:17.591462  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:17.591663  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:17.107424  7238 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.015s	sys 0.060s
I20260709 12:27:17.592921  8441 raft_consensus.cc:2804] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:17.593191  7238 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.195s	user 0.015s	sys 0.061s
I20260709 12:27:17.593542  8441 raft_consensus.cc:493] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:17.594097  8441 raft_consensus.cc:3060] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:17.594769  7238 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49174 (request call id 319) took 1225 ms. Trace:
I20260709 12:27:17.292699  7971 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:27:17.299309  8133 consensus_meta.cc:287] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 0.584s	user 0.012s	sys 0.000s
I20260709 12:27:16.999188  8271 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:17.598583  7943 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.186419  8280 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:17.103348  8299 raft_consensus.cc:493] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.479561  7234 raft_consensus.cc:2468] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:17.017366  8347 leader_election.cc:290] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:17.600039  7234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49174 (request call id 321) took 1102 ms. Trace:
W20260709 12:27:17.242285  8372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.041s	sys 0.039s
I20260709 12:27:17.469714  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:17.600144  8299 raft_consensus.cc:515] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:17.022647  8379 leader_election.cc:290] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:17.306640  8381 raft_consensus.cc:515] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:17.601902  7159 raft_consensus.cc:2393] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 2: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:17.602469  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:17.584712  8502 raft_consensus.cc:2749] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:17.600525  7234 rpcz_store.cc:276] 0709 12:27:16.498118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.500198 (+  2080us) service_pool.cc:224] Handling call
0709 12:27:17.599934 (+1099736us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:17.123992  8401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.009s	sys 0.013s
I20260709 12:27:17.063603  8411 raft_consensus.cc:2749] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713) with higher term. Message: Invalid argument: T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 for earlier term 3. Current term is 4.
W20260709 12:27:17.091416  8498 consensus_meta.cc:287] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 1.071s	user 0.013s	sys 0.000s
W20260709 12:27:17.241324  8507 consensus_meta.cc:287] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 0.739s	user 0.011s	sys 0.000s
I20260709 12:27:16.995262  8512 raft_consensus.cc:3060] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:17.235224  8513 consensus_meta.cc:287] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 1.290s	user 0.010s	sys 0.004s
I20260709 12:27:17.700407  8573 consensus_queue.cc:1048] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:27:17.701328  8513 raft_consensus.cc:515] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:17.702644  7131 leader_election.cc:304] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:17.015993  8515 consensus_queue.cc:1048] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:27:17.104202  8516 leader_election.cc:290] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:17.706331  8498 raft_consensus.cc:515] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:17.707233  8507 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:17.007669  8522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.020s	sys 0.045s
W20260709 12:27:17.709018  8522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.286s	user 0.021s	sys 0.046s
W20260709 12:27:17.108721  8523 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.035s	sys 0.050s
W20260709 12:27:17.710623  8523 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.279s	user 0.036s	sys 0.050s
I20260709 12:27:17.710664  8490 leader_election.cc:290] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:17.177814  8529 raft_consensus.cc:515] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:17.715087  8529 leader_election.cc:290] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:17.717711  8505 leader_election.cc:290] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:27:17.088696  8534 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.037s	sys 0.050s
W20260709 12:27:17.721052  8534 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.358s	user 0.038s	sys 0.050s
I20260709 12:27:17.722059  7233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49174 (request call id 317) took 1642 ms. Trace:
I20260709 12:27:17.699292  8571 consensus_queue.cc:1048] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:27:17.228852  8541 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:17.722131  8574 raft_consensus.cc:2749] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:17.268218  8558 consensus_meta.cc:287] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 0.770s	user 0.009s	sys 0.000s
I20260709 12:27:17.726802  8299 leader_election.cc:290] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:17.726665  8558 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:17.088861  8559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.021s	sys 0.039s
I20260709 12:27:16.863356  8564 consensus_queue.cc:237] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:17.729218  8559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.302s	user 0.021s	sys 0.040s
I20260709 12:27:17.706352  7082 raft_consensus.cc:1240] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:17.182615  8567 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:16.864255  8568 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:17.300390  8581 log.cc:927] Time spent T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:27:17.256424  8584 log.cc:927] Time spent T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:27:17.503590  7008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 344) took 3118 ms. Trace:
I20260709 12:27:17.736728  7008 rpcz_store.cc:276] 0709 12:27:14.385085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.698429 (+313344us) service_pool.cc:224] Handling call
0709 12:27:15.125644 (+427215us) spinlock_profiling.cc:243] Waited 8.2 ms on lock 0x7b58001b0698. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1edfc0 00007f287d1d8929 00007f287d1d83d2 00007f287674fbd4
0709 12:27:15.125821 (+   177us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:15.126117 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:15.126143 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:16.729687 (+1603544us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b2c000004f8. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2876b0da11 00007f2876b1d372 00007f287824fa01 00007f287821443a 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2
0709 12:27:16.761434 (+ 31747us) log.cc:844] Serialized 26 byte log entry
0709 12:27:17.441454 (+680020us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:17.503168 (+ 61714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.503263 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:17.503324 (+    61us) raft_consensus.cc:1685] finished
0709 12:27:17.503335 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.503529 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19345,"raft.queue_time_us":44663,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":27503,"spinlock_wait_cycles":55125248,"thread_start_us":610452,"threads_started":1,"wal-append.queue_time_us":566900}
I20260709 12:27:17.468529  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:17.739342  7235 raft_consensus.cc:2468] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 4.
I20260709 12:27:17.501739  7091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 304) took 2140 ms. Trace:
I20260709 12:27:17.742136  7091 rpcz_store.cc:276] 0709 12:27:15.361299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.995760 (+634461us) service_pool.cc:224] Handling call
0709 12:27:15.996218 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.791422 (+795204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.501135 (+709713us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54001c5cd4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:17.501510 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1679536512}
I20260709 12:27:17.502107  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:17.579243  7016 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.000s	sys 0.014s
I20260709 12:27:17.471309  6980 leader_election.cc:304] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:17.494128  7158 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56784 (request call id 219) took 2196 ms. Trace:
I20260709 12:27:17.584698  8111 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:17.585359  7165 raft_consensus.cc:1275] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:17.600494  7943 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:17.601123  8372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.041s	sys 0.041s
I20260709 12:27:16.889824  8417 raft_consensus.cc:515] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:17.478998  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:17.773639  7232 raft_consensus.cc:2468] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 5.
W20260709 12:27:17.609771  6979 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.045s	sys 0.093s
I20260709 12:27:17.502708  7055 leader_election.cc:304] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:17.774317  8558 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:27:17.775738  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 383450us
I20260709 12:27:17.493160  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:27:17.605049  8401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.134s	user 0.010s	sys 0.013s
I20260709 12:27:17.778362  7943 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:17.778756  7090 raft_consensus.cc:2468] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:17.480065  7009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34232 (request call id 339) took 3270 ms. Trace:
I20260709 12:27:17.779407  7090 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46248 (request call id 253) took 1285 ms. Trace:
I20260709 12:27:17.779773  8498 leader_election.cc:290] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:17.779623  7009 rpcz_store.cc:276] 0709 12:27:14.209287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.656080 (+446793us) service_pool.cc:224] Handling call
0709 12:27:16.488836 (+1832756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.501670 (+ 12834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:16.554691 (+ 53021us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:16.575738 (+ 21047us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:16.579846 (+  4108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.623807 (+ 43961us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.479713 (+855906us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54003eeed0. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782138ad 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:17.479906 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4061168000}
I20260709 12:27:17.476336  7230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 201) took 1182 ms. Trace:
I20260709 12:27:17.757468  7158 rpcz_store.cc:276] 0709 12:27:15.297416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.309692 (+ 12276us) service_pool.cc:224] Handling call
0709 12:27:15.336908 (+ 27216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.545502 (+208594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.493435 (+1947933us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b540082d554. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:17.493877 (+   442us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49985280}
I20260709 12:27:17.605548  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:17.781857  8492 leader_election.cc:290] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:17.782382  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:17.782902  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:17.783902  7159 raft_consensus.cc:2468] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:17.605274  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:17.606702  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:17.785324  7163 raft_consensus.cc:2468] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:17.477378  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:17.605125  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:17.595288  7238 rpcz_store.cc:276] 0709 12:27:16.368900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.369034 (+   134us) service_pool.cc:224] Handling call
0709 12:27:16.369445 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:16.397414 (+ 27969us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:27:16.397458 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:16.397947 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:27:17.594116 (+1196169us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:17.594234 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.594343 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:17.594392 (+    49us) raft_consensus.cc:1685] finished
0709 12:27:17.594405 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.594697 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":227413,"raft.queue_time_us":66344,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":13712,"thread_start_us":1195552,"threads_started":1,"wal-append.queue_time_us":839387}
W20260709 12:27:17.671434  7084 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.008s	sys 0.004s
I20260709 12:27:17.671269  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:17.671681  8587 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:17.672123  7085 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.004s	sys 0.009s
I20260709 12:27:17.672523  7086 raft_consensus.cc:2393] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 3: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
W20260709 12:27:17.674719  6982 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.033s	sys 0.056s
I20260709 12:27:17.676218  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:17.672669  8580 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.681423  8379 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:17.780711  8503 leader_election.cc:290] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:17.793953  8379 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:17.780792  8111 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:17.795130  7085 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.005s	sys 0.009s
I20260709 12:27:17.796651  8111 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:17.685163  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:17.684864  8577 consensus_queue.cc:1059] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:17.686962  7129 leader_election.cc:304] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:17.604544  8381 leader_election.cc:290] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:27:17.672617  6981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.024s	sys 0.047s
I20260709 12:27:17.672772  8316 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.802362  8316 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:17.803225  8592 log.cc:927] Time spent T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.547s	user 0.002s	sys 0.000s
I20260709 12:27:17.722615  7233 rpcz_store.cc:276] 0709 12:27:16.079143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.082437 (+  3294us) service_pool.cc:224] Handling call
0709 12:27:16.148340 (+ 65903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.258951 (+110611us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:16.377375 (+118424us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.452840 (+1075465us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b18003571c0. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287dfefab1 00007f287dffc281 00007f2875109e07 00007f287df649a9 00007f287512669b 00007f287512493f 00007f2875126c02 00007f2877dae20b 00007f2877db3d23 00007f2877db423a 00007f287821ea2a
0709 12:27:17.721260 (+268420us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:17.721373 (+   113us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:17.721509 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.721630 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.721851 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":73903,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":6033,"raft.queue_time_us":1531,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":154,"spinlock_wait_cycles":32439040,"thread_start_us":214607,"threads_started":1}
I20260709 12:27:17.804207  7231 raft_consensus.cc:2468] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:17.732110  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:17.804916  7231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 204) took 1460 ms (client timeout 1755 ms). Trace:
W20260709 12:27:17.805776  6981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.087s	user 0.025s	sys 0.047s
W20260709 12:27:17.764911  7016 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.000s	sys 0.018s
I20260709 12:27:17.808599  7016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34210 (request call id 196) took 1735 ms. Trace:
I20260709 12:27:17.766330  7131 leader_election.cc:304] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:17.766510  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:17.767159  8553 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:17.742729  8507 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:17.743419  8513 leader_election.cc:290] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:27:17.768960  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 297971us
I20260709 12:27:17.773785  7164 raft_consensus.cc:1240] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3. Ops: []
W20260709 12:27:17.774256  6979 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.045s	sys 0.094s
I20260709 12:27:17.475067  7162 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56794 (request call id 292) took 2927 ms. Trace:
W20260709 12:27:17.779253  8542 log.cc:927] Time spent T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 1.750s	user 0.006s	sys 0.000s
W20260709 12:27:17.799105  7084 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.009s	sys 0.005s
W20260709 12:27:17.791877  6982 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.034s	sys 0.056s
I20260709 12:27:17.792739  8580 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:17.683077  7089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46248 (request call id 244) took 2438 ms. Trace:
I20260709 12:27:17.787223  7090 rpcz_store.cc:276] 0709 12:27:16.494408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.494536 (+   128us) service_pool.cc:224] Handling call
0709 12:27:17.492663 (+998127us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b5800035198. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:17.779355 (+286692us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7597440}
W20260709 12:27:17.805346  7231 rpcz_store.cc:269] 0709 12:27:16.344395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.358075 (+ 13680us) service_pool.cc:224] Handling call
0709 12:27:17.477035 (+1118960us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b5800010298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:17.804837 (+327802us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17255808}
I20260709 12:27:17.805365  7236 raft_consensus.cc:2410] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 for term 4 because replica has last-logged OpId of term: 2 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:27:17.598600  8133 raft_consensus.cc:515] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:17.781335  7230 rpcz_store.cc:276] 0709 12:27:16.293779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.343030 (+ 49251us) service_pool.cc:224] Handling call
0709 12:27:16.394407 (+ 51377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.800885 (+406478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.475757 (+674872us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b540062f554. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:17.476098 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":715434368}
W20260709 12:27:17.812903  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 67971.9us
I20260709 12:27:17.784216  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:17.805560  7239 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49174 (request call id 318) took 1679 ms (client timeout 1942 ms). Trace:
I20260709 12:27:17.825937  8417 leader_election.cc:290] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:17.820530  8505 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:17.803256  8577 raft_consensus.cc:3055] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:17.770027  8589 raft_consensus.cc:2804] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:17.812798  8553 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:17.826128  8342 leader_election.cc:290] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:17.808954  8346 consensus_queue.cc:1048] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:27:17.831295  8557 raft_consensus.cc:2804] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:17.831849  7131 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:17.832520  7943 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.809638  7160 raft_consensus.cc:2393] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 4: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
W20260709 12:27:17.833417  7239 rpcz_store.cc:269] 0709 12:27:16.126144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.126324 (+   180us) service_pool.cc:224] Handling call
0709 12:27:17.731686 (+1605362us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b5800010298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:17.805506 (+ 73820us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6702848}
I20260709 12:27:17.809136  8498 raft_consensus.cc:493] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:17.841603  8199 raft_consensus.cc:493] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.842170  8494 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:17.842715  8490 consensus_queue.cc:1059] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:17.843721  8589 raft_consensus.cc:493] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:17.822242  8503 raft_consensus.cc:493] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:17.837353  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 1.03556e+06us
I20260709 12:27:17.832257  8587 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:17.808985  7016 rpcz_store.cc:276] 0709 12:27:16.072904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.078247 (+  5343us) service_pool.cc:224] Handling call
0709 12:27:16.078592 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:16.078958 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:16.078992 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:16.107392 (+ 28400us) log.cc:844] Serialized 26 byte log entry
0709 12:27:16.688828 (+581436us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:17.807722 (+1118894us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.808111 (+   389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.808229 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:17.808308 (+    79us) raft_consensus.cc:1685] finished
0709 12:27:17.808326 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.808503 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15916,"prepare.queue_time_us":890353,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":477,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":41399,"thread_start_us":1548960,"threads_started":2,"wal-append.queue_time_us":956389}
W20260709 12:27:17.843768  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 157200us
I20260709 12:27:17.888185  7165 raft_consensus.cc:2468] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
W20260709 12:27:17.898967  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 67315.6us
W20260709 12:27:17.894043  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 76117.3us
W20260709 12:27:17.893692  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 63795.2us
I20260709 12:27:17.888690  8557 raft_consensus.cc:493] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:17.820941  7089 rpcz_store.cc:276] 0709 12:27:15.245704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.246187 (+   483us) service_pool.cc:224] Handling call
0709 12:27:15.246528 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.246774 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:15.720893 (+474119us) log.cc:844] Serialized 14 byte log entry
0709 12:27:15.936359 (+215466us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b18002a3280. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287dfefab1 00007f287dffc281 00007f28751273f3 00007f28751297c1 00007f2875129779 00007f2875129709 00007f28751296d1 00007f28751289cd 0000000000388634 0000000000388479 00007f287510a83a
0709 12:27:16.334393 (+398034us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.665879 (+1331486us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.680347 (+ 14468us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:17.680671 (+   324us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:17.680983 (+   312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.682035 (+  1052us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.682879 (+   844us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45383,"prepare.queue_time_us":803769,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":5933,"raft.queue_time_us":181642,"raft.run_cpu_time_us":565,"raft.run_wall_time_us":9602,"spinlock_wait_cycles":40169216,"thread_start_us":2323591,"threads_started":5,"wal-append.queue_time_us":403779}
W20260709 12:27:17.905373  8584 log.cc:927] Time spent T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:27:17.840981  8577 raft_consensus.cc:740] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:17.902997  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:17.889986  8574 raft_consensus.cc:493] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:17.893960  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:17.916664  8589 raft_consensus.cc:3060] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:17.893924  8401 raft_consensus.cc:2804] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:17.933139  8417 raft_consensus.cc:2804] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:17.931641  8199 raft_consensus.cc:515] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:17.933678  8498 raft_consensus.cc:515] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:17.925792  8557 raft_consensus.cc:3060] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:17.939327  7009 raft_consensus.cc:1275] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:17.939808  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:17.940085  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:17.940869  7203 leader_election.cc:304] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:17.899501  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:17.904780  7943 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:17.939381  7131 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:17.905553  8505 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:17.937831  8417 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:17.930347  8316 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:17.955281  8580 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:17.953603  7159 raft_consensus.cc:1275] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:17.931483  8503 raft_consensus.cc:515] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:17.956773  8441 raft_consensus.cc:515] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:17.957377  7943 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:17.958781  8503 leader_election.cc:290] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:17.958976  8441 leader_election.cc:290] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:17.952176  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:17.960052  7015 raft_consensus.cc:3060] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:17.921898  8342 consensus_queue.cc:1048] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:27:17.964332  7158 raft_consensus.cc:2410] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for term 7 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:17.964028  8574 raft_consensus.cc:515] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:17.966356  8575 raft_consensus.cc:2749] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:17.966384  8411 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.947235  8401 raft_consensus.cc:697] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:17.967597  7016 raft_consensus.cc:2468] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:17.971122  8133 leader_election.cc:290] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:17.953591  8417 raft_consensus.cc:3060] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:17.971635  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:17.969455  6982 leader_election.cc:304] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:17.975001  7013 raft_consensus.cc:2393] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 3: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:17.962859  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:17.966877  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:17.964818  8587 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:17.978524  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:17.971529  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:17.983074  8369 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:17.949586  8494 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:17.978559  6980 leader_election.cc:304] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:17.977293  7084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 328) took 1055 ms. Trace:
I20260709 12:27:17.983204  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:17.815348  7162 rpcz_store.cc:276] 0709 12:27:14.548370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.089485 (+541115us) service_pool.cc:224] Handling call
0709 12:27:15.177589 (+ 88104us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:15.178000 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:15.178030 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:15.178554 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:27:15.501314 (+322760us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:15.506654 (+  5340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.520136 (+ 13482us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:16.772197 (+1252061us) raft_consensus.cc:1685] finished
0709 12:27:16.772235 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.474396 (+702161us) spinlock_profiling.cc:243] Waited 58 ms on lock 0x7b54007ebdd0. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782138ad 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:17.474850 (+   454us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5653,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":9348,"spinlock_wait_cycles":133304576,"thread_start_us":192860,"threads_started":1,"wal-append.queue_time_us":660940,"wal-append.run_cpu_time_us":4033,"wal-append.run_wall_time_us":1939915}
I20260709 12:27:17.996747  7203 leader_election.cc:304] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:17.997098  8536 raft_consensus.cc:2804] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:17.991509  7084 rpcz_store.cc:276] 0709 12:27:16.921840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.927329 (+  5489us) service_pool.cc:224] Handling call
0709 12:27:17.057463 (+130134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:17.082175 (+ 24712us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:27:17.824213 (+742038us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.919486 (+ 95273us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:17.926317 (+  6831us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:17.944247 (+ 17930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.949951 (+  5704us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.976187 (+ 26236us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":498337,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":70,"raft.queue_time_us":15732,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":10860,"thread_start_us":769161,"threads_started":2,"wal-append.queue_time_us":86922}
I20260709 12:27:17.990698  7009 raft_consensus.cc:1240] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:18.007071  8455 raft_consensus.cc:3055] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:18.007543  8455 raft_consensus.cc:740] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:18.008011  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:18.008899  7016 raft_consensus.cc:2468] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 1.
I20260709 12:27:18.008636  8455 consensus_queue.cc:260] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:18.009902  8574 leader_election.cc:290] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:17.998118  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
W20260709 12:27:18.000027  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 60770.2us
I20260709 12:27:17.976193  8316 raft_consensus.cc:493] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:17.980000  8411 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:17.980664  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:18.015312  8484 consensus_queue.cc:1048] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:18.016247  8346 raft_consensus.cc:2804] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:18.017755  8539 consensus_queue.cc:1048] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:27:18.018206  7055 connection.cc:256] RPC call timeout handler was delayed by -1.816140839000127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
I20260709 12:27:18.020955  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:18.021320  7239 raft_consensus.cc:1240] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:18.021855  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:18.022033  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:17.997526  8536 raft_consensus.cc:493] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.030357  7015 raft_consensus.cc:2468] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:17.993917  8577 consensus_queue.cc:260] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:18.030810  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:18.035287  7231 raft_consensus.cc:2393] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 3: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:18.035921  7010 raft_consensus.cc:1240] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:18.036089  7230 raft_consensus.cc:3060] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.039569  8199 leader_election.cc:290] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:18.049407  7013 raft_consensus.cc:2393] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 4: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:18.036909  7082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 327) took 1142 ms. Trace:
I20260709 12:27:18.036932  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:18.025315  8503 raft_consensus.cc:2749] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:18.025533  8346 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.066020  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:18.067816  7055 connection.cc:256] RPC call timeout handler was delayed by -1.7502624039998409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
I20260709 12:27:18.067934  8441 raft_consensus.cc:493] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:18.038820  7233 raft_consensus.cc:2468] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:18.054302  7082 rpcz_store.cc:276] 0709 12:27:16.894966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.895985 (+  1019us) service_pool.cc:224] Handling call
0709 12:27:16.896292 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:17.730670 (+834378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.036620 (+305950us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b540032e454. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:18.036851 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1859697408}
I20260709 12:27:18.070024  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
W20260709 12:27:18.070888  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 103603us
I20260709 12:27:18.071926  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:18.022398  8514 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:18.039142  8342 raft_consensus.cc:2749] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:18.037467  8536 raft_consensus.cc:3060] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.080947  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:18.083045  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 52147.2us
I20260709 12:27:18.010533  8401 consensus_queue.cc:237] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:18.083694  8484 raft_consensus.cc:493] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:18.105079  8484 raft_consensus.cc:515] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:18.086850  7014 raft_consensus.cc:2410] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:27:18.085520  7055 connection.cc:256] RPC call timeout handler was delayed by -1.5836689800003114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
W20260709 12:27:18.107825  7055 connection.cc:256] RPC call timeout handler was delayed by -1.5425408390001394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.211s for a response
W20260709 12:27:18.108175  7055 connection.cc:256] RPC call timeout handler was delayed by -1.4174408389999371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
W20260709 12:27:18.108464  7055 connection.cc:256] RPC call timeout handler was delayed by -1.3958408389999022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22730000000000003s for a response
I20260709 12:27:18.072608  8492 consensus_queue.cc:1059] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:18.110582  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:18.111183  8580 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:18.111857  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:18.080760  7009 raft_consensus.cc:2468] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 5.
I20260709 12:27:18.112718  7091 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 6.
I20260709 12:27:18.113744  8441 raft_consensus.cc:515] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:18.042325  8316 raft_consensus.cc:515] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:18.117936  7238 raft_consensus.cc:2468] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 2.
I20260709 12:27:18.089458  7161 raft_consensus.cc:2468] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:18.121912  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:18.123528  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:18.125303  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:18.126302  7233 raft_consensus.cc:2468] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 5.
I20260709 12:27:18.127642  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:18.128727  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
W20260709 12:27:18.129359  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 187264us
I20260709 12:27:18.129897  7012 raft_consensus.cc:2393] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 3: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:18.130215  6982 leader_election.cc:304] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:18.131904  6982 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:18.133278  8505 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:18.134055  8505 raft_consensus.cc:2804] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:18.134369  8505 raft_consensus.cc:493] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:18.134766  8505 raft_consensus.cc:3060] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:18.041963  8539 consensus_queue.cc:1048] T f99919774f3a4dda86c7c90ad327b9bd P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:27:18.073386  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:18.095525  7011 raft_consensus.cc:2468] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 5.
I20260709 12:27:18.079162  8346 raft_consensus.cc:3060] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.099287  6980 leader_election.cc:304] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:18.100508  8617 log.cc:927] Time spent T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:27:18.090667  8553 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:18.149686  7230 raft_consensus.cc:2468] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:18.111953  8580 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:18.116436  8441 leader_election.cc:290] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:18.128387  7233 raft_consensus.cc:2468] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:18.156934  7162 raft_consensus.cc:3060] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.070045  8372 consensus_queue.cc:1048] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:27:18.157069  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:18.163265  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:18.157267  8589 raft_consensus.cc:515] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:18.159746  7129 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:18.153558  8498 leader_election.cc:290] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:18.153900  8514 raft_consensus.cc:2749] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:18.195169  8406 raft_consensus.cc:2804] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:18.195669  8406 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:18.196091  8406 raft_consensus.cc:3060] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:18.196734  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:27:18.194902  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 95762.2us
I20260709 12:27:18.201256  8494 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:18.163902  8411 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:18.202098  6980 leader_election.cc:304] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:18.154330  8557 raft_consensus.cc:515] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:18.203030  6980 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:18.203289  7156 raft_consensus.cc:2393] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 5: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:18.204077  8557 leader_election.cc:290] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:18.194852  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:18.204227  6980 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:18.169207  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:18.169858  8503 raft_consensus.cc:2749] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:18.172899  8553 raft_consensus.cc:3055] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:18.218426  8494 raft_consensus.cc:2804] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:18.200673  8512 raft_consensus.cc:515] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:18.244129  8514 raft_consensus.cc:2749] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:18.243505  8553 raft_consensus.cc:740] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:18.255476  8411 raft_consensus.cc:2804] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:18.279121  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 74956us
I20260709 12:27:18.271437  8494 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:27:18.297010  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 137381us
W20260709 12:27:18.300736  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 168951us
I20260709 12:27:18.276913  8522 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.309029  8580 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
    @     0x7f28747ed930 google::LogMessage::Flush() at ??:0
I20260709 12:27:18.311470  8568 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:18.314950  7083 raft_consensus.cc:1240] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:18.316926  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:18.317824  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:18.318207  7083 raft_consensus.cc:2410] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:18.284196  7084 raft_consensus.cc:2468] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
W20260709 12:27:18.325366  6981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.328262  7162 raft_consensus.cc:2410] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:27:18.329937  8512 leader_election.cc:290] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:18.330586  7055 leader_election.cc:304] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:18.331660  8512 raft_consensus.cc:2804] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:18.332064  8512 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:18.332468  8512 raft_consensus.cc:3060] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.332685  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:18.333511  8536 raft_consensus.cc:515] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:18.334522  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:18.335603  8536 leader_election.cc:290] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:18.280961  8411 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.338143  6980 leader_election.cc:304] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:18.331996  7055 leader_election.cc:304] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:18.297812  8494 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:18.341688  6982 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:18.336494  7084 raft_consensus.cc:1240] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:18.340360  8411 raft_consensus.cc:3060] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:18.352926  8589 leader_election.cc:290] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:18.342772  8522 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:18.347009  8514 raft_consensus.cc:2749] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:18.363796  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 79594.8us
I20260709 12:27:18.350060  8568 raft_consensus.cc:493] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.336678  8553 consensus_queue.cc:260] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:18.374842  8620 log.cc:927] Time spent T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:27:18.357291  8580 raft_consensus.cc:493] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:18.395120  7233 raft_consensus.cc:1275] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:27:18.426054  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 94251.6us
I20260709 12:27:18.368235  8515 raft_consensus.cc:2749] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:18.370041  8568 raft_consensus.cc:515] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:18.426750  7083 raft_consensus.cc:1275] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:27:18.437849  8398 raft_consensus.cc:2749] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:18.440388  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 71583.3us
I20260709 12:27:18.434669  7083 pending_rounds.cc:85] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca: Aborting all ops after (but not including) 1
I20260709 12:27:18.441546  6980 leader_election.cc:304] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:18.442407  7083 pending_rounds.cc:107] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:27:18.447741  7083 raft_consensus.cc:2889] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:18.453147  8522 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:18.442011  8369 raft_consensus.cc:2749] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:18.443497  8553 raft_consensus.cc:3060] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:18.433003  8417 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:18.464731  8557 raft_consensus.cc:493] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.452003  8515 raft_consensus.cc:2749] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:18.438993  8580 raft_consensus.cc:515] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:18.468304  8621 log.cc:927] Time spent T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:27:18.477138  6982 leader_election.cc:304] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:18.468245  8557 raft_consensus.cc:515] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:18.485813  8514 raft_consensus.cc:2804] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:18.486186  7160 raft_consensus.cc:2393] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 4: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:18.486305  8514 raft_consensus.cc:493] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:18.486897  8514 raft_consensus.cc:3060] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:18.487340  8568 leader_election.cc:290] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:18.466488  8406 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:18.488761  7055 leader_election.cc:304] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:18.489595  8513 raft_consensus.cc:2749] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:18.490200  7055 leader_election.cc:304] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:18.491806  8580 leader_election.cc:290] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:18.494359  8406 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:18.493423  8417 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:18.496886  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:18.497601  7089 raft_consensus.cc:2468] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:18.499011  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:18.499153  8411 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:18.499553  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:18.499866  7015 raft_consensus.cc:1275] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:18.500254  7016 raft_consensus.cc:2393] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 4: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:18.501420  8401 raft_consensus.cc:493] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:18.495967  8512 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:18.505333  8401 raft_consensus.cc:515] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:18.510514  8401 leader_election.cc:290] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:27:18.506456  8622 log.cc:927] Time spent T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:27:18.512471  8278 leader_election.cc:290] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:18.513815  8512 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:18.515453  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:18.517357  7055 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:18.532279  8557 leader_election.cc:290] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:18.533222  8411 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:18.541235  8575 raft_consensus.cc:2749] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:18.543238  8401 consensus_queue.cc:1059] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:18.544938  8401 raft_consensus.cc:3055] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:18.528090  8513 raft_consensus.cc:2749] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:18.545476  8401 raft_consensus.cc:740] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
W20260709 12:27:18.548180  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 81370.3us
I20260709 12:27:18.552376  7055 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:18.562100  8575 raft_consensus.cc:2749] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:18.562875  8575 consensus_queue.cc:1048] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:18.565485  7055 leader_election.cc:304] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:18.566111  8346 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:18.566151  8455 raft_consensus.cc:3060] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.557896  8505 raft_consensus.cc:515] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:18.563971  8514 raft_consensus.cc:515] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:18.573547  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:18.574132  7089 raft_consensus.cc:1275] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:18.577261  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:18.575239  7128 leader_election.cc:304] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:18.569072  8557 consensus_queue.cc:1048] T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:27:18.578727  8369 raft_consensus.cc:2804] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:18.579144  8369 raft_consensus.cc:493] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.579499  8369 raft_consensus.cc:3060] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.584597  8512 raft_consensus.cc:2804] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:18.585258  8512 raft_consensus.cc:493] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:18.585807  8512 raft_consensus.cc:3060] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:18.586588  7086 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46248 (request call id 254) took 2091 ms (client timeout 2074 ms). Trace:
W20260709 12:27:18.587061  7086 rpcz_store.cc:269] 0709 12:27:16.494700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.713129 (+218429us) service_pool.cc:224] Handling call
0709 12:27:18.586364 (+1873235us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b5400504bd4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:18.586521 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1884504448}
I20260709 12:27:18.588593  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:18.585821  7085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 321) took 1793 ms. Trace:
I20260709 12:27:18.598407  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:18.603597  8379 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:18.604877  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:18.605850  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:18.606719  7009 raft_consensus.cc:2393] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 4: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:18.608330  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:18.609284  7237 raft_consensus.cc:2468] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 6.
I20260709 12:27:18.613013  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:18.613634  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:18.616456  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:18.616961  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:18.617272  7013 raft_consensus.cc:2393] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 3: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:18.617568  7230 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 6.
I20260709 12:27:18.598577  7085 rpcz_store.cc:276] 0709 12:27:16.792187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.804192 (+ 12005us) service_pool.cc:224] Handling call
0709 12:27:16.852741 (+ 48549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.894012 (+ 41271us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:17.055052 (+161040us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.795768 (+740716us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:17.795873 (+   105us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:17.795961 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.796046 (+    85us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b18003e66e0. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287dfefab1 00007f287dffc281 00007f2875127522 00007f28751297c1 00007f2875129779 00007f2875129709 00007f28751296d1 00007f28751289cd 0000000000388634 0000000000388479 00007f287510a83a
0709 12:27:18.585504 (+789458us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b5400250dd4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:18.585575 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.585740 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4544,"prepare.queue_time_us":106765,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":3520,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3951,"spinlock_wait_cycles":70600576,"thread_start_us":714774,"threads_started":1,"wal-append.queue_time_us":614648}
I20260709 12:27:18.619469  8316 leader_election.cc:290] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:18.619869  8417 raft_consensus.cc:493] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.594204  8401 consensus_queue.cc:260] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:18.620328  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:18.625193  7014 raft_consensus.cc:3060] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:18.620334  8417 raft_consensus.cc:515] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:18.612196  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:18.627492  8623 log.cc:927] Time spent T 8e234c90d1214131938d5c23c9ace832 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.317s	user 0.003s	sys 0.000s
I20260709 12:27:18.627457  7007 raft_consensus.cc:2468] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 1.
I20260709 12:27:18.621803  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
W20260709 12:27:18.640779  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:18.641886  8252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.019s	sys 0.015s
W20260709 12:27:18.642297  8252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.020s	sys 0.015s
I20260709 12:27:18.643050  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:18.648900  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:18.649782  7082 raft_consensus.cc:3060] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:18.650527  8613 log.cc:927] Time spent T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.621s	user 0.000s	sys 0.007s
I20260709 12:27:18.652134  7235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49160 (request call id 259) took 1798 ms. Trace:
I20260709 12:27:18.652508  7235 rpcz_store.cc:276] 0709 12:27:16.853911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.740306 (+886395us) service_pool.cc:224] Handling call
0709 12:27:17.740813 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:17.741401 (+   588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.741440 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:17.767707 (+ 26267us) log.cc:844] Serialized 26 byte log entry
0709 12:27:17.847881 (+ 80174us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:17.925959 (+ 78078us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.935508 (+  9549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.941808 (+  6300us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:18.357753 (+415945us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b18003e5f60. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287dfefab1 00007f287dffc281 00007f2875127522 00007f28751297c1 00007f2875129779 00007f2875129709 00007f28751296d1 00007f28751289cd 0000000000388634 0000000000388479 00007f287510a83a
0709 12:27:18.649936 (+292183us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b4400022b4c. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f287504dc85 00007f287504e6a2 00007f2877dc01db 00007f2877dbbaaf 00007f2877daf86e 00007f2877daebb6 00007f2877dae7d8 00007f2877db8221 00007f2877db81d9 00007f2877db8169
0709 12:27:18.651881 (+  1945us) raft_consensus.cc:1685] finished
0709 12:27:18.651905 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.652054 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9414,"prepare.queue_time_us":38973,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":5107,"raft.queue_time_us":8770,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":35406,"spinlock_wait_cycles":9072768,"thread_start_us":52302,"threads_started":1,"wal-append.queue_time_us":193872}
I20260709 12:27:18.656013  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:18.656306  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:18.656948  7013 raft_consensus.cc:2468] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:18.658985  7236 raft_consensus.cc:2468] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:18.659658  7129 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:18.660601  7129 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:18.660930  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:18.661417  8111 raft_consensus.cc:2804] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:18.661819  7129 leader_election.cc:304] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:18.662227  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:18.662245  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:18.662819  7230 raft_consensus.cc:3060] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:18.662912  8587 raft_consensus.cc:2804] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:18.661823  8111 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.663376  8587 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.663854  8111 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:18.663901  7014 raft_consensus.cc:2468] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:18.663944  8587 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:18.670022  8538 raft_consensus.cc:2804] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:18.670161  8398 consensus_queue.cc:1048] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:18.670956  8538 raft_consensus.cc:697] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:18.590334  8494 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:18.596000  8505 leader_election.cc:290] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:18.682282  7230 raft_consensus.cc:2468] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 6.
I20260709 12:27:18.688177  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:18.690047  7129 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:18.691776  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 100602us
I20260709 12:27:18.668206  8346 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:18.673947  8417 leader_election.cc:290] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:18.695901  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:18.700042  7008 raft_consensus.cc:2368] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 4. Current term is 5.
I20260709 12:27:18.686821  7085 raft_consensus.cc:1240] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:18.700649  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:18.700148  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:18.711520  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:18.704208  7128 leader_election.cc:304] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:18.672199  8538 consensus_queue.cc:237] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:18.701583  8574 raft_consensus.cc:2804] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:18.714931  7088 raft_consensus.cc:3060] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.719331  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:18.720367  7089 raft_consensus.cc:3060] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:18.720028  7008 raft_consensus.cc:2468] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 5.
I20260709 12:27:18.721861  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:18.723824  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:18.703189  8398 consensus_queue.cc:1059] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:27:18.726737  8398 raft_consensus.cc:3055] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:18.727140  8398 raft_consensus.cc:740] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:18.723501  8252 raft_consensus.cc:2804] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:18.729571  8252 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.730026  8252 raft_consensus.cc:3060] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:18.700147  8557 consensus_queue.cc:1059] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:27:18.732028  8557 raft_consensus.cc:3055] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:18.732431  8557 raft_consensus.cc:740] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:18.733511  8557 consensus_queue.cc:260] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:18.734874  8557 raft_consensus.cc:3060] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.743840  7012 raft_consensus.cc:2468] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:18.744007  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:18.728084  8398 consensus_queue.cc:260] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:18.745203  7086 raft_consensus.cc:2393] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 5: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:18.745806  8398 raft_consensus.cc:3060] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:18.751521  7082 raft_consensus.cc:2468] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:18.754452  8494 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:18.756099  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:18.756960  7011 raft_consensus.cc:2393] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 2: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
    @     0x7f28747f2a6b google::LogMessageFatal::~LogMessageFatal() at ??:0
I20260709 12:27:18.762646  6980 leader_election.cc:304] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:18.764068  6980 leader_election.cc:304] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:18.764334  7205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.765017  7014 raft_consensus.cc:1275] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:27:18.794817  7014 pending_rounds.cc:85] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6: Aborting all ops after (but not including) 1
I20260709 12:27:18.795193  7014 pending_rounds.cc:107] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:27:18.766191  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:18.766405  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:18.798066  7090 raft_consensus.cc:2468] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:27:18.766844  7055 leader_election.cc:304] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:18.768186  7087 raft_consensus.cc:1240] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:27:18.768777  8455 raft_consensus.cc:2804] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:18.769977  8505 raft_consensus.cc:2749] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:18.768748  8111 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:18.771730  7164 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56794 (request call id 296) took 1269 ms. Trace:
W20260709 12:27:18.774591  8596 log.cc:927] Time spent T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 1.100s	user 0.002s	sys 0.004s
I20260709 12:27:18.790082  8252 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:18.806656  8252 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:18.777230  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:18.780800  8484 leader_election.cc:290] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:18.771243  6980 leader_election.cc:304] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
W20260709 12:27:18.809244  7129 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.809790  6980 leader_election.cc:304] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:18.783900  8439 consensus_queue.cc:1048] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:18.800918  7164 rpcz_store.cc:276] 0709 12:27:17.502444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.503214 (+   770us) service_pool.cc:224] Handling call
0709 12:27:17.503712 (+   498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:17.820534 (+316822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.771476 (+950942us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54001a2554. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:18.771653 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":619989248}
I20260709 12:27:18.800292  7014 raft_consensus.cc:2889] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:18.801074  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 81704.6us
I20260709 12:27:18.810662  8111 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 7 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:18.814731  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:18.815384  7238 raft_consensus.cc:2468] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:18.789368  8401 raft_consensus.cc:3060] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:18.725378  8574 raft_consensus.cc:697] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 6 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
W20260709 12:27:18.820087  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:18.820201  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:18.820904  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:18.824004  8577 raft_consensus.cc:3060] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:18.751827  8369 raft_consensus.cc:515] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:18.833755  7128 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:18.825273  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:27:18.830075  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 63291.5us
I20260709 12:27:18.831379  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:18.836535  7086 raft_consensus.cc:2468] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:27:18.800220  8455 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:18.843461  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:18.818264  8494 raft_consensus.cc:2749] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:18.833156  8505 raft_consensus.cc:2804] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:18.856765  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:18.841022  7235 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:18.857082  8369 leader_election.cc:290] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:18.845757  8484 raft_consensus.cc:493] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.860306  7055 leader_election.cc:304] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:18.845641  8455 raft_consensus.cc:3060] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.843489  8441 raft_consensus.cc:2749] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:18.843463  8514 leader_election.cc:290] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:18.851557  8417 raft_consensus.cc:2804] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:18.872857  7131 leader_election.cc:304] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:18.875854  6982 connection.cc:256] RPC call timeout handler was delayed by -1.0157079240002531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
I20260709 12:27:18.862227  8505 raft_consensus.cc:493] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:18.880036  7205 leader_election.cc:304] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:18.880702  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:18.881976  7131 leader_election.cc:304] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:18.883220  7131 leader_election.cc:304] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:18.878901  8507 raft_consensus.cc:493] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.884213  8631 raft_consensus.cc:2804] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:18.884641  8631 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.875942  8346 consensus_queue.cc:1048] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:27:18.885013  8631 raft_consensus.cc:3060] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:18.886233  7083 raft_consensus.cc:2410] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:27:18.872030  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:18.898450  7089 raft_consensus.cc:2468] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 5.
I20260709 12:27:18.900385  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:18.873870  8484 raft_consensus.cc:515] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:18.904632  7088 raft_consensus.cc:2468] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:18.906935  7016 raft_consensus.cc:2368] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5.
I20260709 12:27:18.874786  8417 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:18.913039  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:18.914449  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:18.902034  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:18.881631  8505 raft_consensus.cc:3060] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:18.873515  8252 consensus_queue.cc:1048] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:27:18.921150  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:18.921885  7007 raft_consensus.cc:1275] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:18.884502  8507 raft_consensus.cc:515] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:18.923338  7009 raft_consensus.cc:1240] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:18.924036  8507 leader_election.cc:290] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:18.877570  8133 consensus_queue.cc:1059] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 12:27:18.925140  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:18.926777  7203 leader_election.cc:304] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:18.927606  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:18.928205  7014 raft_consensus.cc:2468] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 5.
I20260709 12:27:18.928844  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:18.930061  8369 raft_consensus.cc:2804] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:18.930584  8369 raft_consensus.cc:697] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:18.931493  8369 consensus_queue.cc:237] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:18.914291  8417 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:18.933346  8506 raft_consensus.cc:3055] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:18.933775  8506 raft_consensus.cc:740] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:18.934165  7230 raft_consensus.cc:1275] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:18.934651  8506 consensus_queue.cc:260] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:18.935969  7008 raft_consensus.cc:2468] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:27:18.937253  7239 raft_consensus.cc:1240] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:27:18.938617  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:18.938481  7943 consensus_queue.cc:1175] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e6e5c8ad44447588681b10df7ad79ca" responder_term: 3 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:18.939536  7015 raft_consensus.cc:2410] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:27:18.941674  8587 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:18.943856  8587 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 7 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:18.921932  7013 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 6.
I20260709 12:27:18.945454  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:18.945789  8512 raft_consensus.cc:515] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:18.948647  8484 leader_election.cc:290] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:18.949069  8639 raft_consensus.cc:3060] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:18.949450  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:18.870186  8574 consensus_queue.cc:237] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:18.954196  8522 raft_consensus.cc:2804] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:18.954679  8522 raft_consensus.cc:493] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.955027  8522 raft_consensus.cc:3060] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.936285  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:18.961746  8640 log.cc:927] Time spent T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:27:18.902943  8439 raft_consensus.cc:2749] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:18.906956  8346 raft_consensus.cc:2749] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:18.968272  7091 raft_consensus.cc:2410] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:18.968465  7084 raft_consensus.cc:3060] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.944211  8631 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:18.968384  8512 leader_election.cc:290] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:18.971949  8631 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:18.973451  7238 raft_consensus.cc:2468] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:18.975828  8455 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:18.986061  8455 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:18.976926  6911 catalog_manager.cc:5697] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:18.978192  8553 consensus_meta.cc:287] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.000s
I20260709 12:27:18.979657  7234 raft_consensus.cc:1240] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:18.989751  6911 catalog_manager.cc:5697] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 1 to 2, leader changed from e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68) to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 2 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:18.919109  7205 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:18.992255  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 77521.1us
I20260709 12:27:18.992410  8553 raft_consensus.cc:2804] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:18.993072  8553 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.993532  8553 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:19.000713  6911 catalog_manager.cc:5697] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 1 to 4, leader changed from e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68) to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 4 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:19.007524  6911 catalog_manager.cc:5697] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 2 to 3, leader changed from 022925662268440c91fff7e8732d7a0b (127.3.200.67) to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 3 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:18.983636  6913 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48294 (request call id 61) took 9312 ms. Trace:
I20260709 12:27:18.970656  8417 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:19.011416  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 93297.4us
W20260709 12:27:19.012447  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 141213us
I20260709 12:27:19.019673  7235 raft_consensus.cc:2468] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 7.
I20260709 12:27:18.979589  8522 raft_consensus.cc:515] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:19.025367  7055 leader_election.cc:304] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:19.028870  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 145716us
I20260709 12:27:19.023828  8553 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:19.041077  7057 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.042658  6911 catalog_manager.cc:5697] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:19.046674  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 186570us
I20260709 12:27:19.060784  7055 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:19.061185  7128 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:19.062721  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:19.063604  7238 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:19.064457  7055 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:19.065739  7055 leader_election.cc:304] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:19.071676  7129 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:19.071830  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:19.041113  8631 raft_consensus.cc:2804] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:19.100840  7013 raft_consensus.cc:2468] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:19.111936  7054 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
W20260709 12:27:19.121717  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 49518.4us
I20260709 12:27:19.121690  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:19.123896  7015 raft_consensus.cc:1240] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:19.114355  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:19.071624  8398 raft_consensus.cc:2804] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:19.069073  8575 raft_consensus.cc:2804] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:19.125828  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 58632.7us
I20260709 12:27:19.098666  8649 raft_consensus.cc:493] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.099124  8580 raft_consensus.cc:2749] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:19.131825  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 63553.1us
W20260709 12:27:19.132429  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.126968  8398 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.131228  7012 raft_consensus.cc:1240] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:27:19.126622  8634 raft_consensus.cc:2749] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:19.136490  8398 raft_consensus.cc:3060] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.014351  6913 rpcz_store.cc:276] 0709 12:27:09.670797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.676663 (+  5866us) service_pool.cc:224] Handling call
0709 12:27:18.983355 (+9306692us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:13.395370 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:13.543808 (+148438us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:13.546458 (+  2650us) write_op.cc:435] Acquired schema lock
0709 12:27:13.547984 (+  1526us) tablet.cc:662] Decoding operations
0709 12:27:13.742611 (+194627us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:13.742702 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:13.742747 (+    45us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:27:13.882886 (+140139us) tablet.cc:701] Row locks acquired
0709 12:27:13.882901 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:27:13.883066 (+   165us) write_op.cc:270] Start()
0709 12:27:13.883203 (+   137us) write_op.cc:276] Timestamp: P: 1783600033883005 usec, L: 0
0709 12:27:13.883226 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:27:13.901389 (+ 18163us) log.cc:844] Serialized 5154 byte log entry
0709 12:27:14.771643 (+870254us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b540018c2a0. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817e090 00007f287818b6b8 00007f287818b2fa 00007f287820f965 00007f287820fe09 00007f287bc4a581 00007f287bc49d58 00007f287bc4e9f1 00007f287bc4e9a9 00007f287bc4e939 00007f287bc4e901
0709 12:27:14.772292 (+   649us) op_driver.cc:464] REPLICATION: finished
0709 12:27:15.833950 (+1061658us) write_op.cc:301] APPLY: starting
0709 12:27:15.838279 (+  4329us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:15.879342 (+ 41063us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:15.880160 (+   818us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:16.031073 (+150913us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:16.245562 (+214489us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:27:16.267967 (+ 22405us) write_op.cc:312] APPLY: finished
0709 12:27:16.393423 (+125456us) log.cc:844] Serialized 94 byte log entry
0709 12:27:16.641310 (+247887us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b540014a854. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f287821132a 00007f2878196f14 00007f2878196ec3 00007f2878196e38 00007f2878196df3 00007f28781960dc 00007f28781bfe16 00007f28781a7cbb 00007f287819239d 00007f2878195d75
0709 12:27:17.711280 (+1069970us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:17.711767 (+   487us) write_op.cc:454] Released schema lock
0709 12:27:17.711880 (+   113us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:17.727551 (+ 15671us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:17.727585 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":134955,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":1002460,"apply.run_cpu_time_us":93027,"apply.run_wall_time_us":1893746,"num_ops":13,"prepare.queue_time_us":119429,"prepare.run_cpu_time_us":51741,"prepare.run_wall_time_us":1376573,"raft.queue_time_us":133467,"raft.run_cpu_time_us":35500,"raft.run_wall_time_us":2352501,"replication_time_us":888910,"spinlock_wait_cycles":1137939968,"thread_start_us":2545165,"threads_started":5,"wal-append.queue_time_us":1053956,"wal-append.run_cpu_time_us":44074,"wal-append.run_wall_time_us":2232604}]]}
I20260709 12:27:19.139619  8528 consensus_queue.cc:1059] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:27:19.146445  8528 raft_consensus.cc:3055] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:19.146893  8528 raft_consensus.cc:740] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:19.147989  8528 consensus_queue.cc:260] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:19.149633  8528 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.150084  7084 raft_consensus.cc:2468] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:27:19.131604  8401 raft_consensus.cc:2804] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:19.153606  8505 raft_consensus.cc:515] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:19.072377  7231 raft_consensus.cc:1240] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 6. Current term is 7. Ops: [4.2-6.3]
I20260709 12:27:19.125262  8631 raft_consensus.cc:697] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:19.168098  7054 leader_election.cc:304] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:19.169303  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:19.173372  7013 raft_consensus.cc:1275] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:27:19.073453  8557 raft_consensus.cc:2804] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:19.173497  7164 raft_consensus.cc:3060] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.171582  7238 raft_consensus.cc:2468] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 7.
I20260709 12:27:19.129710  8575 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:27:19.150173  8645 log.cc:927] Time spent T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:27:19.179746  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:19.180393  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:19.183579  8398 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:19.166742  8401 raft_consensus.cc:697] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 7 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:19.184783  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:19.185046  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:19.198344  8634 raft_consensus.cc:2749] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:19.198587  7012 raft_consensus.cc:1240] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:27:19.199095  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:19.199777  7162 raft_consensus.cc:3060] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:19.200775  8401 consensus_queue.cc:237] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:19.202235  8398 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:19.187461  7160 raft_consensus.cc:1240] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:27:19.188738  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:19.188671  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:19.137609  8649 raft_consensus.cc:515] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:19.193457  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 127808us
I20260709 12:27:19.207275  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:19.137162  7234 raft_consensus.cc:1275] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:19.199563  8439 consensus_queue.cc:1048] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:19.188241  8639 raft_consensus.cc:2749] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:19.204440  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 69998.1us
I20260709 12:27:19.165779  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:19.206578  7129 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:19.192497  8575 raft_consensus.cc:3060] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:19.219201  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 51229.2us
I20260709 12:27:19.183068  8557 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:19.152117  6911 catalog_manager.cc:5697] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "022925662268440c91fff7e8732d7a0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } }
I20260709 12:27:19.212962  7158 raft_consensus.cc:2468] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 5.
I20260709 12:27:19.214596  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:19.215711  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:19.215867  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:19.216758  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:19.217162  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:19.234022  7055 leader_election.cc:304] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:19.234081  7054 leader_election.cc:304] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:19.240655  7013 raft_consensus.cc:1240] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:19.247485  7203 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:19.230652  8557 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:19.231105  8506 raft_consensus.cc:3060] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:19.233052  8650 raft_consensus.cc:2804] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:19.250315  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:19.231542  8505 leader_election.cc:290] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:19.213618  8512 consensus_queue.cc:1048] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:27:19.217523  8398 consensus_queue.cc:1059] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:27:19.254760  7011 raft_consensus.cc:2468] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:19.243762  8513 raft_consensus.cc:2804] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:19.246286  7160 raft_consensus.cc:3060] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:19.244247  8417 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:19.262053  8522 leader_election.cc:290] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:19.258448  8631 consensus_queue.cc:237] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:19.262399  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:19.263123  7012 raft_consensus.cc:3060] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:27:19.265285  8649 leader_election.cc:290] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:19.266455  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:19.266613  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:19.267217  7008 raft_consensus.cc:3060] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:19.278967  8528 consensus_queue.cc:1059] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:19.279507  8553 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:19.280224  8528 raft_consensus.cc:3055] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:19.272904  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:19.281404  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:19.282155  7236 raft_consensus.cc:2368] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4.
I20260709 12:27:19.280664  8528 raft_consensus.cc:740] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:19.283746  8528 consensus_queue.cc:260] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:19.274471  8574 consensus_queue.cc:1048] T 459d2d4cd4d0458fba1105fdc8dd504a P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:27:19.284952  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:19.285324  7234 raft_consensus.cc:1240] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:19.286270  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:19.290974  7163 raft_consensus.cc:2468] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:19.260344  8634 raft_consensus.cc:493] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:19.246551  8441 consensus_queue.cc:1059] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:27:19.297062  7128 leader_election.cc:304] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:19.300859  8634 raft_consensus.cc:515] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:19.302556  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:19.285392  8528 raft_consensus.cc:3060] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:19.274808  8580 raft_consensus.cc:2804] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:19.303802  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:19.304109  8580 raft_consensus.cc:493] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.304519  8580 raft_consensus.cc:3060] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.304859  8213 raft_consensus.cc:2749] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:19.305739  7055 leader_election.cc:400] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Vote denied by peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743) with higher term. Message: Invalid argument: T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4.
I20260709 12:27:19.306082  7055 leader_election.cc:403] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:27:19.307744  7012 raft_consensus.cc:2468] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
    @     0x7f287e7e4a9e kudu::TestWorkload::Setup() at ??:0
I20260709 12:27:19.311043  7164 raft_consensus.cc:2468] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 5.
I20260709 12:27:19.311285  8557 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
    @           0x35fb88 kudu::master::LeaderRebalancerTest::CreateWorkloadTable() at /apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:112
I20260709 12:27:19.303334  8634 leader_election.cc:290] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
    @           0x358216 kudu::master::LeaderRebalancerTest_RestartTserver_Test::TestBody() at /apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:?
I20260709 12:27:19.304477  7013 raft_consensus.cc:2468] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:19.259130  8650 raft_consensus.cc:697] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 7 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:19.318185  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:19.324429  7202 leader_election.cc:336] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921): Timed out: RequestConsensusVote RPC to 127.3.200.65:34921 timed out after 1.878s (SENT)
I20260709 12:27:19.292629  8513 raft_consensus.cc:697] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:19.313688  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:19.332698  7128 leader_election.cc:304] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:19.326936  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:19.332232  7011 raft_consensus.cc:1240] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:19.329002  7202 leader_election.cc:304] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:19.325911  8398 raft_consensus.cc:3055] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:27:19.340854  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.328094  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
W20260709 12:27:19.332993  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 99022.8us
I20260709 12:27:19.338335  7238 raft_consensus.cc:1240] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:19.293004  6911 catalog_manager.cc:5697] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65). New cstate: current_term: 1 leader_uuid: "2c146bd91ab94c5191365c34a414a5e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:19.345701  8417 raft_consensus.cc:2804] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:19.334329  8369 raft_consensus.cc:2749] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:19.341825  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:19.345728  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:19.352522  8513 consensus_queue.cc:237] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:19.361477  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:19.351215  7128 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:19.356775  7054 leader_election.cc:304] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:19.334452  8441 raft_consensus.cc:3055] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:19.347056  7162 raft_consensus.cc:2468] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:27:19.349047  8634 raft_consensus.cc:2749] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743) with higher term. Message: Invalid argument: T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4.
I20260709 12:27:19.364267  7128 leader_election.cc:304] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:19.373147  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:19.326987  8213 consensus_queue.cc:1059] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:27:19.369707  8649 raft_consensus.cc:2749] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:19.335531  8133 consensus_queue.cc:1059] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:27:19.382308  8484 consensus_queue.cc:1048] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:19.383627  8648 raft_consensus.cc:2804] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:19.384685  7128 leader_election.cc:304] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:19.385250  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:19.385354  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:19.398175  8663 raft_consensus.cc:2804] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:19.398761  8663 raft_consensus.cc:697] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:19.399329  7159 raft_consensus.cc:1240] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260709 12:27:19.361958  8417 raft_consensus.cc:493] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.400763  8417 raft_consensus.cc:3060] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.387100  8646 consensus_queue.cc:1059] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:19.389202  8577 raft_consensus.cc:493] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:19.350617  8398 raft_consensus.cc:740] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:19.392005  6980 leader_election.cc:304] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:19.418669  6980 leader_election.cc:304] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:19.397105  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:19.398010  8455 consensus_queue.cc:1059] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:27:19.386018  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 73616.5us
I20260709 12:27:19.367828  8441 raft_consensus.cc:740] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:19.399811  8663 consensus_queue.cc:237] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:19.364341  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
W20260709 12:27:19.384481  8655 log.cc:927] Time spent T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:27:19.410662  7205 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:19.417217  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 60636.8us
I20260709 12:27:19.367611  8522 raft_consensus.cc:2749] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:19.375178  8439 raft_consensus.cc:493] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.413142  7008 raft_consensus.cc:2468] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:19.414795  7943 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:19.432363  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:19.440380  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 55766.8us
I20260709 12:27:19.404372  7157 raft_consensus.cc:2468] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 5.
I20260709 12:27:19.433378  8505 raft_consensus.cc:2804] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:19.448335  7054 leader_election.cc:400] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921) with higher term. Message: Invalid argument: T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 4. Current term is 5.
I20260709 12:27:19.417398  8649 raft_consensus.cc:3055] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:19.529855  7203 leader_election.cc:304] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:19.441895  7205 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:19.446601  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:19.431223  8503 raft_consensus.cc:2804] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:19.533181  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:19.533850  7008 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:19.535596  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 93784.1us
I20260709 12:27:19.537168  7203 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
W20260709 12:27:19.543704  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 102186us
I20260709 12:27:19.450076  8417 raft_consensus.cc:515] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:19.430583  8398 consensus_queue.cc:260] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:19.544754  7054 leader_election.cc:304] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:19.551684  7054 leader_election.cc:304] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:19.553364  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:19.554318  7011 raft_consensus.cc:2468] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:19.546470  7008 raft_consensus.cc:2468] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 6.
I20260709 12:27:19.419617  8133 raft_consensus.cc:3055] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:19.529605  8649 raft_consensus.cc:740] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:19.538625  8503 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.539608  8522 raft_consensus.cc:2804] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:19.557063  8505 raft_consensus.cc:697] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:19.597220  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:19.598090  7087 raft_consensus.cc:2393] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 4: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:19.597697  8505 consensus_queue.cc:237] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:19.599092  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:19.599687  7087 raft_consensus.cc:2468] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:19.569813  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:19.570223  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:19.570899  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:19.601846  7091 raft_consensus.cc:2393] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 2: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:19.571403  8455 raft_consensus.cc:493] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:19.571559  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:19.571440  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:19.602593  7089 raft_consensus.cc:3060] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:19.572163  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:19.572866  8396 raft_consensus.cc:2804] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:19.573027  8398 raft_consensus.cc:3060] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:19.536829  8111 consensus_queue.cc:1059] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:27:19.574024  7157 raft_consensus.cc:1240] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:27:19.450845  8316 consensus_queue.cc:1059] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.107s
I20260709 12:27:19.415313  8650 consensus_queue.cc:237] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:19.576483  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:19.546471  8213 raft_consensus.cc:2804] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:19.637365  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.580647  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:19.641705  7008 raft_consensus.cc:2393] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 3: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
W20260709 12:27:19.445096  7202 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.200.65:34921 timed out after 2.559s (SENT) [suppressed 22 similar messages]
W20260709 12:27:19.583112  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 46766.8us
I20260709 12:27:19.563567  8553 raft_consensus.cc:2749] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:19.528718  7943 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:19.587944  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:19.521164  8439 raft_consensus.cc:515] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:19.615572  7057 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.600512  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:19.561146  8667 raft_consensus.cc:2804] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:19.600903  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:19.665277  7089 raft_consensus.cc:2468] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:19.665668  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:19.434790  8648 raft_consensus.cc:697] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
W20260709 12:27:19.603106  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 65975us
I20260709 12:27:19.670969  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:19.617333  8396 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:27:19.615856  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 327601us
I20260709 12:27:19.648273  8522 raft_consensus.cc:697] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:19.645622  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:19.584244  8512 raft_consensus.cc:2749] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:27:19.644081  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 199008us
I20260709 12:27:19.602414  8503 raft_consensus.cc:3060] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:19.662504  8667 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:19.425166  8577 raft_consensus.cc:515] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:19.657652  7086 raft_consensus.cc:2368] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3.
I20260709 12:27:19.584734  8133 raft_consensus.cc:740] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:19.658016  7091 raft_consensus.cc:1240] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:27:19.667867  7157 raft_consensus.cc:1240] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:27:19.671669  7088 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 6.
I20260709 12:27:19.682611  8396 raft_consensus.cc:3060] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.676836  7016 raft_consensus.cc:1240] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:19.646610  8213 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:19.659410  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:19.625823  8455 raft_consensus.cc:515] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:19.643185  7205 leader_election.cc:304] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:19.692512  8553 raft_consensus.cc:493] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.435351  7159 raft_consensus.cc:1240] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [term 6 LEADER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:19.699725  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:19.725414  7089 raft_consensus.cc:2393] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 2: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:19.678776  8316 raft_consensus.cc:3055] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:19.701627  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:19.449173  8369 raft_consensus.cc:2804] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:19.728015  8369 raft_consensus.cc:493] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.728190  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:19.728438  8369 raft_consensus.cc:3060] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.729616  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:19.730768  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:19.731293  7007 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:19.699759  7010 raft_consensus.cc:2393] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 6: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:19.732600  8316 raft_consensus.cc:740] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:19.733629  7010 raft_consensus.cc:1275] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:19.733520  8316 consensus_queue.cc:260] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:19.690878  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:19.714946  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 71872.8us
I20260709 12:27:19.716509  8580 raft_consensus.cc:515] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:19.738783  7128 leader_election.cc:304] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:19.738559  8133 consensus_queue.cc:260] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:19.739893  8133 raft_consensus.cc:3060] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:19.739979  7128 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:19.740569  8580 leader_election.cc:290] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:27:19.740993  8681 log.cc:927] Time spent T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:27:19.741421  7090 raft_consensus.cc:2393] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 5: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:19.716929  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:19.742244  7157 raft_consensus.cc:2468] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:19.738579  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:19.717658  7164 raft_consensus.cc:1240] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:19.718362  7091 raft_consensus.cc:1240] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:19.719491  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:19.692896  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:19.707597  8660 log.cc:927] Time spent T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 12:27:19.724198  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:19.839299  7016 raft_consensus.cc:3060] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:19.720335  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:19.701072  8484 consensus_queue.cc:1059] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:27:19.691208  8663 consensus_queue.cc:1059] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:27:19.842792  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:19.843606  8663 raft_consensus.cc:3055] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:19.844087  8663 raft_consensus.cc:740] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:19.844561  7156 raft_consensus.cc:1240] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:19.845140  8663 consensus_queue.cc:260] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:19.846745  8663 raft_consensus.cc:3060] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:19.708838  7085 raft_consensus.cc:1240] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 LEADER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:27:19.702417  8667 raft_consensus.cc:3060] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.711797  8213 raft_consensus.cc:3060] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.714213  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:19.849586  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:19.850921  7083 raft_consensus.cc:1240] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:27:19.761898  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:19.853547  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:19.854820  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:19.762982  8406 raft_consensus.cc:2804] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:19.762756  8648 consensus_queue.cc:237] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:19.761268  8668 raft_consensus.cc:493] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:19.726378  8553 raft_consensus.cc:515] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:19.769261  8672 log.cc:927] Time spent T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:27:19.772992  7943 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:19.775136  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:19.869692  7232 raft_consensus.cc:2393] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 3: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:19.776130  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:19.777251  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:19.778566  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:19.871618  7230 raft_consensus.cc:2393] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 7: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:19.781118  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:19.872097  7237 raft_consensus.cc:3060] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.781406  8675 raft_consensus.cc:2804] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:19.782225  8677 consensus_queue.cc:1059] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:19.783073  7055 leader_election.cc:304] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:19.780366  7007 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 7.
I20260709 12:27:19.783747  7234 raft_consensus.cc:1240] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:27:19.785643  8455 leader_election.cc:290] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:19.786015  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:19.787139  8557 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:19.789616  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:19.790125  7015 raft_consensus.cc:1240] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:19.791659  8507 raft_consensus.cc:3055] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:19.793747  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:27:19.794003  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 54090.9us
I20260709 12:27:19.793637  8441 consensus_queue.cc:260] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:19.794799  8679 raft_consensus.cc:2804] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:19.795455  7131 leader_election.cc:304] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:19.796952  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:19.888003  7089 raft_consensus.cc:2393] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 3: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:19.797041  8646 raft_consensus.cc:3055] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:27:19.800091  8669 log.cc:927] Time spent T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:27:19.802129  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:19.803402  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:19.803923  8682 log.cc:927] Time spent T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:27:19.804289  8346 raft_consensus.cc:3055] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:19.899674  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:19.805068  8575 consensus_meta.cc:287] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.568s	user 0.011s	sys 0.000s
I20260709 12:27:19.805207  6982 leader_election.cc:304] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:19.806689  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:19.684901  8649 consensus_queue.cc:260] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:19.913300  8649 raft_consensus.cc:3060] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:19.915830  8506 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.882079  8507 raft_consensus.cc:740] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:19.916661  8506 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:19.917282  8507 consensus_queue.cc:260] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:19.813768  8417 leader_election.cc:290] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:19.918771  8507 raft_consensus.cc:3060] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.815373  8439 leader_election.cc:290] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:19.796453  7159 raft_consensus.cc:1240] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 3. Current term is 5. Ops: []
I20260709 12:27:19.817831  8577 leader_election.cc:290] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:19.818863  8503 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:19.822149  8369 raft_consensus.cc:515] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:19.800110  7160 consensus_meta.cc:287] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 0.513s	user 0.006s	sys 0.003s
I20260709 12:27:19.746261  7084 raft_consensus.cc:2410] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:19.852324  7083 raft_consensus.cc:1275] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:19.809670  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:19.860110  7016 raft_consensus.cc:2468] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:27:19.826612  8396 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:19.863178  7205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:19.878618  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 159189us
I20260709 12:27:19.859561  7231 raft_consensus.cc:3060] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:19.879671  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 96723.8us
I20260709 12:27:19.884013  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:19.870378  8406 raft_consensus.cc:697] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 4 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:19.885119  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:19.950821  7086 raft_consensus.cc:1275] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:19.885876  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:19.897650  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 102263us
I20260709 12:27:19.952267  7131 leader_election.cc:304] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:19.880664  8398 raft_consensus.cc:2749] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:19.876180  8668 raft_consensus.cc:515] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:19.902351  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
W20260709 12:27:19.902459  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 97342.1us
I20260709 12:27:19.902901  8575 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:19.903177  8455 raft_consensus.cc:2749] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:19.903322  8316 raft_consensus.cc:3060] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.896309  8441 raft_consensus.cc:3060] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:19.908792  8553 leader_election.cc:290] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:19.915768  8505 raft_consensus.cc:493] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.021123  8505 raft_consensus.cc:515] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:20.023517  8505 leader_election.cc:290] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:19.900497  8346 raft_consensus.cc:740] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:19.782945  8522 consensus_queue.cc:237] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:20.004395  7232 raft_consensus.cc:1275] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:19.882520  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:20.025949  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:19.922547  7236 raft_consensus.cc:1275] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:19.936898  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:19.937630  8369 leader_election.cc:290] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:19.938849  8506 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:19.922678  8503 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:19.923365  7160 raft_consensus.cc:2468] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:27:20.029547  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:19.924816  7162 raft_consensus.cc:1240] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:20.030817  8506 consensus_queue.cc:1048] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:19.925071  7238 raft_consensus.cc:1240] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:20.031574  8346 consensus_queue.cc:260] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:19.926466  8396 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:19.930018  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:20.033043  7161 raft_consensus.cc:2393] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 5: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:20.033401  7012 raft_consensus.cc:2468] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:20.033564  8133 raft_consensus.cc:2749] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:19.931231  6980 leader_election.cc:304] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:20.034962  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 103829us
I20260709 12:27:20.035378  8575 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:20.036242  7085 raft_consensus.cc:1240] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:19.944578  7157 raft_consensus.cc:1240] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 7 LEADER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:19.930474  7015 raft_consensus.cc:1240] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:20.036865  7128 leader_election.cc:304] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:19.920544  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:20.037494  8668 leader_election.cc:290] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:19.932209  7055 leader_election.cc:304] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:20.039037  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 106903us
I20260709 12:27:20.036170  6980 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:19.944206  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:20.041081  7016 raft_consensus.cc:3060] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:20.042445  8553 consensus_queue.cc:1048] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.043962  8553 consensus_queue.cc:1059] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:19.948783  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:20.044695  8396 consensus_queue.cc:1048] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.044977  7008 raft_consensus.cc:2468] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:20.046198  8484 consensus_queue.cc:1059] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:19.890779  8646 raft_consensus.cc:740] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:19.981328  8685 raft_consensus.cc:3055] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:19.899909  8679 raft_consensus.cc:697] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 6 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:20.048609  8685 raft_consensus.cc:740] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:20.048236  8646 consensus_queue.cc:260] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:20.049242  8679 consensus_queue.cc:237] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:20.049490  8685 consensus_queue.cc:260] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:20.050218  8646 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:19.963990  7131 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
W20260709 12:27:19.932250  8587 consensus_queue.cc:1175] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2c146bd91ab94c5191365c34a414a5e6" responder_term: 3 status { last_received { term: 0 index: 0 } last_committed_idx: 0 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:27:20.051627  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 87710.6us
I20260709 12:27:20.052630  8398 raft_consensus.cc:2749] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:20.053844  8398 consensus_queue.cc:1048] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:19.981190  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:19.982084  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:19.982826  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:19.983381  8574 raft_consensus.cc:2804] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:19.985805  8406 consensus_queue.cc:237] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:20.055965  7943 raft_consensus.cc:2804] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:20.056600  7943 raft_consensus.cc:697] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [term 4 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:20.057106  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:20.056156  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:20.057670  7943 consensus_queue.cc:237] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:19.996605  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:20.000754  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:20.003149  7233 raft_consensus.cc:1275] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:20.063378  7165 raft_consensus.cc:1240] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [term 7 LEADER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 6. Current term is 7. Ops: [6.3-6.3]
W20260709 12:27:19.968019  7056 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.012866  8692 consensus_queue.cc:1059] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:20.033816  8346 raft_consensus.cc:3060] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.038057  8133 raft_consensus.cc:2804] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:20.048007  7237 raft_consensus.cc:2468] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 5.
I20260709 12:27:20.050675  8685 raft_consensus.cc:3060] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:20.076717  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:20.056640  8677 raft_consensus.cc:3055] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:19.992934  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:20.059628  7202 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:19.974967  7235 raft_consensus.cc:1275] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:27:20.061992  7131 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:20.040751  6980 leader_election.cc:304] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:20.064051  7128 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.064313  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:20.040063  7055 leader_election.cc:304] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:20.105945  7011 raft_consensus.cc:2368] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 4. Current term is 5.
I20260709 12:27:20.072448  7016 raft_consensus.cc:2468] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 5.
W20260709 12:27:20.105932  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 65257.7us
I20260709 12:27:20.056001  8574 raft_consensus.cc:697] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 5 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:20.063588  8455 raft_consensus.cc:2749] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:20.109524  7014 raft_consensus.cc:1240] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:20.108894  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:20.080363  6982 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:20.069221  8675 raft_consensus.cc:697] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:20.112967  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:20.077436  7012 raft_consensus.cc:2376] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4. Re-sending same reply.
W20260709 12:27:20.115542  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 75591.6us
I20260709 12:27:20.117570  7055 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:20.067890  8133 raft_consensus.cc:493] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.107513  6980 leader_election.cc:304] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:20.078943  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:20.130954  7013 raft_consensus.cc:2393] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 2: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:20.059137  8439 consensus_queue.cc:1059] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
W20260709 12:27:20.108304  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 48744.7us
I20260709 12:27:20.065153  8503 raft_consensus.cc:2749] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:20.123411  7015 raft_consensus.cc:2393] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 3: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
W20260709 12:27:20.124294  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 43988.9us
I20260709 12:27:20.135270  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:20.135291  6982 leader_election.cc:304] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:20.086586  8677 raft_consensus.cc:740] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:20.133636  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:20.068380  8639 consensus_queue.cc:1059] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:27:20.142110  7012 raft_consensus.cc:2376] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 7. Re-sending same reply.
I20260709 12:27:20.150558  7128 leader_election.cc:304] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
W20260709 12:27:20.128949  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 197406us
I20260709 12:27:20.151538  7015 raft_consensus.cc:1275] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:20.123724  8111 raft_consensus.cc:2749] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:20.154215  7012 raft_consensus.cc:1240] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:27:20.108467  8668 raft_consensus.cc:493] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:20.143013  7202 leader_election.cc:304] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:20.143833  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:20.156396  7008 raft_consensus.cc:3060] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:20.108851  8507 raft_consensus.cc:2749] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:20.111485  7009 raft_consensus.cc:3060] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:20.130657  7010 raft_consensus.cc:2393] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 4: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:20.142266  6982 leader_election.cc:304] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:20.152729  7055 leader_election.cc:304] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:20.142781  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:20.154114  7016 raft_consensus.cc:1240] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:20.122253  8575 raft_consensus.cc:2749] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:20.132920  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:20.094146  8401 consensus_queue.cc:1048] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:27:20.102375  8649 consensus_queue.cc:1048] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:27:20.132028  8505 raft_consensus.cc:2749] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:20.133013  8133 raft_consensus.cc:3060] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:20.161755  6982 leader_election.cc:304] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:20.142028  8587 consensus_queue.cc:1059] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:27:20.134186  8528 raft_consensus.cc:2749] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
    @     0x7f2875357e10 testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
I20260709 12:27:20.150614  8455 raft_consensus.cc:2749] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:27:20.173986  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 66533.2us
I20260709 12:27:20.208614  6980 leader_election.cc:304] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:20.152107  8398 raft_consensus.cc:2749] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:20.087006  8667 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:20.184116  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 75963.6us
I20260709 12:27:20.189680  7128 leader_election.cc:304] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:20.170185  7055 leader_election.cc:304] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
W20260709 12:27:20.217715  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 47646.7us
I20260709 12:27:20.221266  7091 raft_consensus.cc:1275] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:20.222182  8631 consensus_queue.cc:1059] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.223137  8631 raft_consensus.cc:3055] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:20.223615  8631 raft_consensus.cc:740] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:20.143558  8676 consensus_queue.cc:1048] T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 12:27:20.187548  7056 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.182247  8694 consensus_queue.cc:1059] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:27:20.196997  6982 leader_election.cc:304] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:20.199407  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.143424  8557 consensus_queue.cc:1048] T 647e97c99a2a4c41a8f6e6570074411f P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:27:20.167760  8668 raft_consensus.cc:515] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:20.171057  8503 raft_consensus.cc:2804] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:20.157938  8703 raft_consensus.cc:2804] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:20.179360  8663 raft_consensus.cc:2804] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:20.214921  6980 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:20.215387  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 72438.6us
I20260709 12:27:20.223064  8441 consensus_queue.cc:1059] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:20.168322  8417 consensus_queue.cc:1059] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:27:20.204157  8538 consensus_queue.cc:1048] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.230914  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:20.235545  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:20.228617  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:20.319785  7084 raft_consensus.cc:2468] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:20.320807  7086 raft_consensus.cc:3055] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:20.211830  8411 raft_consensus.cc:3060] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.240106  7008 raft_consensus.cc:2468] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 5.
I20260709 12:27:20.233744  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:20.326107  7090 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:20.244282  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 54689.9us
I20260709 12:27:20.226282  8528 raft_consensus.cc:2749] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:20.342844  7128 leader_election.cc:304] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:20.306068  7202 leader_election.cc:304] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:20.344695  7202 leader_election.cc:304] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
W20260709 12:27:20.307039  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 92187.6us
I20260709 12:27:20.309094  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:20.309496  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:20.309999  7091 raft_consensus.cc:1240] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:20.310145  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:20.305006  8676 raft_consensus.cc:2804] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:20.305172  8575 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:20.311892  7083 raft_consensus.cc:1240] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 2. Current term is 3. Ops: [1.1-2.2]
I20260709 12:27:20.305022  8703 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.312597  8441 consensus_queue.cc:1243] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer 022925662268440c91fff7e8732d7a0b log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:27:20.312786  7087 raft_consensus.cc:2468] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 5.
I20260709 12:27:20.305081  8503 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:20.245756  7237 raft_consensus.cc:1240] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:20.353945  7009 raft_consensus.cc:2468] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 5.
I20260709 12:27:20.247088  7233 raft_consensus.cc:1275] T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:20.305308  7007 raft_consensus.cc:2410] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:27:20.346299  8316 raft_consensus.cc:3060] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:20.356346  7158 raft_consensus.cc:2376] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2. Re-sending same reply.
I20260709 12:27:20.358610  8503 raft_consensus.cc:3060] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:20.360733  8346 raft_consensus.cc:2749] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:20.361402  8111 raft_consensus.cc:3055] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:20.361821  8111 raft_consensus.cc:740] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:20.362284  8668 leader_election.cc:290] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:20.360801  8650 raft_consensus.cc:3060] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:20.362901  8668 consensus_queue.cc:1059] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.362922  8396 raft_consensus.cc:3055] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:20.364050  8396 raft_consensus.cc:740] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:20.364940  8396 consensus_queue.cc:260] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:20.367128  8703 raft_consensus.cc:3060] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:20.370096  7088 raft_consensus.cc:1240] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:27:20.370807  8650 raft_consensus.cc:2749] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:20.362623  8111 consensus_queue.cc:260] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:20.314209  8699 raft_consensus.cc:493] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.372536  8699 raft_consensus.cc:515] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:20.373392  8111 raft_consensus.cc:3060] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:20.333812  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:20.373869  8505 raft_consensus.cc:2749] T afc5926243c0439fb58fe23dcbd604a1 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:20.366348  8396 raft_consensus.cc:3060] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:20.314384  8506 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.375427  8506 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:20.335239  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:20.339680  8667 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:20.227599  8694 raft_consensus.cc:3055] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:20.226588  8693 raft_consensus.cc:3055] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:20.204798  8675 consensus_queue.cc:237] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:20.206019  8574 consensus_queue.cc:237] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:20.307585  8455 raft_consensus.cc:2749] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:20.243615  8513 raft_consensus.cc:2804] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:20.351329  7202 leader_election.cc:304] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:20.371677  8575 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:20.373296  8676 raft_consensus.cc:697] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 5 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:20.374289  7084 raft_consensus.cc:2468] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:20.305742  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:20.321293  7086 raft_consensus.cc:740] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
W20260709 12:27:20.433879  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 118464us
I20260709 12:27:20.375167  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:27:20.434764  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 83512.1us
I20260709 12:27:20.435247  7091 raft_consensus.cc:2393] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 5: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
W20260709 12:27:20.377892  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.378728  7090 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 7.
I20260709 12:27:20.435833  7202 leader_election.cc:304] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
W20260709 12:27:20.336391  8691 log.cc:927] Time spent T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 12:27:20.318089  8580 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
W20260709 12:27:20.346227  8701 log.cc:927] Time spent T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:27:20.374616  8505 raft_consensus.cc:2749] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:20.374732  8699 leader_election.cc:290] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:20.346179  6980 leader_election.cc:304] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:20.207162  8677 consensus_queue.cc:260] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:20.342010  8213 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:20.440109  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 97365.4us
I20260709 12:27:20.415838  8694 raft_consensus.cc:740] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
W20260709 12:27:20.464677  7231 consensus_meta.cc:287] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.002s
I20260709 12:27:20.464444  8694 consensus_queue.cc:260] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:20.465087  7231 raft_consensus.cc:2468] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 5.
I20260709 12:27:20.465782  8694 raft_consensus.cc:3060] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:27:20.466187  7233 raft_consensus.cc:1240] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:20.224545  8631 consensus_queue.cc:260] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:20.418495  8693 raft_consensus.cc:740] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:20.451381  7202 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
W20260709 12:27:20.455536  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 109427us
I20260709 12:27:20.473651  6980 leader_election.cc:304] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:20.434803  7086 consensus_queue.cc:260] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:20.424872  8577 raft_consensus.cc:3055] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:27:20.457901  7204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.430390  8346 raft_consensus.cc:2749] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:20.461792  7164 raft_consensus.cc:1240] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 6 LEADER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:20.426980  8513 raft_consensus.cc:493] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:27:20.476486  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.478346  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:20.479875  7230 raft_consensus.cc:1240] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:20.485822  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:20.480109  7086 raft_consensus.cc:3060] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:20.486861  7055 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:20.488677  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:20.468766  8705 raft_consensus.cc:2749] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:20.447026  8667 consensus_queue.cc:1059] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:27:20.495882  7205 leader_election.cc:304] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:20.455369  8580 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:20.535596  7202 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:20.477895  8577 raft_consensus.cc:740] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:20.487041  8513 raft_consensus.cc:3060] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.482040  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:20.482232  8455 raft_consensus.cc:2804] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:20.492888  8679 raft_consensus.cc:493] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:20.556963  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 360028us
I20260709 12:27:20.496676  8663 raft_consensus.cc:697] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:20.592085  7091 raft_consensus.cc:1240] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:20.598629  6982 leader_election.cc:304] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:20.484156  8713 consensus_queue.cc:1059] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:27:20.494664  8699 consensus_queue.cc:1059] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:27:20.595366  7231 raft_consensus.cc:1275] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 12:27:20.612730  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 77212.7us
I20260709 12:27:20.622061  7202 leader_election.cc:304] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
W20260709 12:27:20.612886  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 120797us
I20260709 12:27:20.599411  7156 raft_consensus.cc:2393] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 5: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:20.561363  8667 consensus_queue.cc:1048] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:27:20.489961  8650 consensus_queue.cc:1048] T 0308ffb97aa94594bc22307383a7869b P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:27:20.624352  7239 raft_consensus.cc:1275] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:27:20.625484  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.600081  8455 raft_consensus.cc:697] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:20.616386  8528 raft_consensus.cc:2749] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:20.559665  8679 raft_consensus.cc:515] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:20.638252  7202 leader_election.cc:304] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:20.621073  7231 pending_rounds.cc:85] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41: Aborting all ops after (but not including) 1
W20260709 12:27:20.619496  8685 consensus_meta.cc:287] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.002s
I20260709 12:27:20.607520  8346 raft_consensus.cc:2749] T 77b568a9d33646ddab98b1429efa026e P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:20.630576  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:20.637477  6982 leader_election.cc:304] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:20.627264  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 140445us
I20260709 12:27:20.763773  7091 raft_consensus.cc:2468] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 5.
I20260709 12:27:20.764451  7055 leader_election.cc:304] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
W20260709 12:27:20.764029  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 268233us
W20260709 12:27:20.682866  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 44707.2us
I20260709 12:27:20.765581  7205 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:20.610116  8503 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:20.680985  8213 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:20.677456  8729 raft_consensus.cc:2804] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:20.638954  8705 raft_consensus.cc:2749] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:20.631871  8506 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:20.728971  8455 consensus_queue.cc:237] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:20.679772  8679 leader_election.cc:290] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
W20260709 12:27:20.684227  8706 log.cc:927] Time spent T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.226s	user 0.001s	sys 0.001s
I20260709 12:27:20.653548  8711 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:20.589951  8676 consensus_queue.cc:237] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:20.654083  8715 raft_consensus.cc:2749] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:20.683858  8316 raft_consensus.cc:2749] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:20.652781  7231 pending_rounds.cc:107] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:27:20.663986  8713 raft_consensus.cc:3055] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:20.661756  8722 raft_consensus.cc:3055] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:20.679726  8133 raft_consensus.cc:515] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:20.672639  8699 raft_consensus.cc:2749] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:20.662487  8709 raft_consensus.cc:2749] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:20.653772  8580 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:27:20.678001  8710 log.cc:927] Time spent T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:27:20.672871  8575 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:20.759917  8724 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:20.720428  8663 consensus_queue.cc:237] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:20.761098  8646 consensus_meta.cc:287] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 0.696s	user 0.011s	sys 0.000s
I20260709 12:27:20.616227  8507 raft_consensus.cc:2749] T 798483090bd74738a29fe018ce19422f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:20.812039  7090 raft_consensus.cc:3055] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:20.812489  7090 raft_consensus.cc:740] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:20.813241  7090 consensus_queue.cc:260] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:20.814338  7090 raft_consensus.cc:3060] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:20.815162  7234 raft_consensus.cc:1275] T b3af91840ca144a7b9595ccb5dfd4527 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:20.765689  7202 leader_election.cc:304] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:20.768504  7205 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
W20260709 12:27:20.773556  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 148492us
I20260709 12:27:20.781075  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:20.816642  8724 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:20.782407  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 145013us
I20260709 12:27:20.817929  8503 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:20.818252  6982 leader_election.cc:304] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:20.819061  8724 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:20.819389  6982 leader_election.cc:304] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:20.819609  8724 raft_consensus.cc:2749] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:20.784646  8667 raft_consensus.cc:2804] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:27:20.820290  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 54680.1us
I20260709 12:27:20.785104  8505 raft_consensus.cc:2804] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:20.785821  7235 raft_consensus.cc:2468] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 4.
I20260709 12:27:20.820520  6982 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:20.821976  7202 leader_election.cc:304] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:20.822216  8709 raft_consensus.cc:2749] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:20.822935  8709 raft_consensus.cc:2804] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:20.823204  6982 leader_election.cc:400] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713) with higher term. Message: Invalid argument: T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3.
I20260709 12:27:20.823388  8709 raft_consensus.cc:697] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:20.777347  8694 raft_consensus.cc:2804] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:20.823910  8503 raft_consensus.cc:2764] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:27:20.824147  8694 raft_consensus.cc:697] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:20.786712  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:20.676491  8703 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:20.786942  8513 raft_consensus.cc:515] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:20.682616  8577 consensus_queue.cc:260] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:20.788268  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:20.777283  8729 raft_consensus.cc:493] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:27:20.798331  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 172618us
I20260709 12:27:20.793385  8411 raft_consensus.cc:2749] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:20.799278  8713 raft_consensus.cc:740] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:20.799536  7231 raft_consensus.cc:2889] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:20.800858  8722 raft_consensus.cc:740] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:20.795440  8721 raft_consensus.cc:493] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.823555  6982 leader_election.cc:403] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:20.824358  8709 consensus_queue.cc:237] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:20.851655  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.863189  7164 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56782 (request call id 243) took 1586 ms. Trace:
I20260709 12:27:20.831924  7087 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46248 (request call id 269) took 1250 ms. Trace:
I20260709 12:27:20.905223  7164 rpcz_store.cc:276] 0709 12:27:19.277225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:19.808990 (+531765us) service_pool.cc:224] Handling call
0709 12:27:19.809252 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:20.479451 (+670199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:20.862971 (+383520us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b54007eb3d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:20.863136 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1500111616}
I20260709 12:27:20.905371  7087 rpcz_store.cc:276] 0709 12:27:19.581780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:19.600265 (+ 18485us) service_pool.cc:224] Handling call
0709 12:27:20.831776 (+1231511us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54005ac154. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:20.831868 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1503652608}
I20260709 12:27:20.830278  7085 raft_consensus.cc:2468] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:20.831667  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:20.907375  7236 raft_consensus.cc:2468] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 5.
W20260709 12:27:20.830658  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 62285.2us
I20260709 12:27:20.847455  7128 leader_election.cc:304] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:20.792081  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 54871.6us
I20260709 12:27:20.820351  8724 raft_consensus.cc:3060] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:20.914727  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 91655.7us
I20260709 12:27:20.915603  6982 leader_election.cc:304] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:20.916877  6982 leader_election.cc:304] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:20.824513  8639 raft_consensus.cc:3055] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:20.828227  8577 raft_consensus.cc:3060] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:20.829875  8513 leader_election.cc:290] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:20.850128  8729 raft_consensus.cc:3060] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:20.821982  8133 leader_election.cc:290] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:20.830809  8316 raft_consensus.cc:2749] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:20.946419  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:20.947081  7086 raft_consensus.cc:2468] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:20.929224  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
W20260709 12:27:20.926767  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 79437.6us
I20260709 12:27:20.827448  8703 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:20.820843  8667 raft_consensus.cc:697] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:20.821203  8505 raft_consensus.cc:697] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:20.887035  8677 raft_consensus.cc:3060] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:20.928301  7131 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:20.924248  8705 raft_consensus.cc:2749] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713) with higher term. Message: Invalid argument: T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 for earlier term 2. Current term is 3.
W20260709 12:27:20.858281  8661 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:27:20.863842  8580 raft_consensus.cc:493] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.940399  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:20.856081  8575 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.934893  7090 raft_consensus.cc:1275] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 7 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:27:20.948953  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:20.971012  7090 pending_rounds.cc:85] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca: Aborting all ops after (but not including) 3
I20260709 12:27:20.971273  7009 raft_consensus.cc:1240] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:20.950225  7087 raft_consensus.cc:2393] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 5: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:20.944962  8411 raft_consensus.cc:2749] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:20.956974  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:20.920145  8503 raft_consensus.cc:2749] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:20.959844  7014 raft_consensus.cc:1275] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:20.929144  8726 raft_consensus.cc:493] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:20.944449  7057 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:20.830112  8716 consensus_queue.cc:1175] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e6e5c8ad44447588681b10df7ad79ca" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:20.938257  8574 raft_consensus.cc:2804] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:20.929493  8639 raft_consensus.cc:740] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:20.969393  7011 raft_consensus.cc:1275] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:27:20.992797  7011 pending_rounds.cc:85] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6: Aborting all ops after (but not including) 1
I20260709 12:27:20.971290  7084 raft_consensus.cc:3060] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:27:20.971293  7090 pending_rounds.cc:107] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:27:20.993918  7090 raft_consensus.cc:2889] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:20.938393  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:20.855854  8707 consensus_queue.cc:1048] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 12:27:20.977715  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:20.976112  7013 raft_consensus.cc:2468] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:20.995517  7012 raft_consensus.cc:3060] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:20.925470  8507 consensus_queue.cc:1048] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:27:20.825109  8694 consensus_queue.cc:237] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:20.981251  7008 raft_consensus.cc:1275] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:27:20.975639  8735 raft_consensus.cc:2804] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:20.986977  7086 raft_consensus.cc:1275] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:20.993145  7011 pending_rounds.cc:107] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:27:20.996369  7128 leader_election.cc:304] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:20.983875  7164 raft_consensus.cc:1240] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:21.003201  7011 raft_consensus.cc:2889] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:20.913731  8721 raft_consensus.cc:515] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:20.820744  8693 consensus_queue.cc:260] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:20.851429  8713 consensus_queue.cc:260] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:20.978207  8513 consensus_queue.cc:1048] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:27:20.991961  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
W20260709 12:27:21.005756  8398 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:27:20.978281  8575 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:20.975229  8580 raft_consensus.cc:515] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:21.023999  7012 raft_consensus.cc:2468] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:20.994899  8574 raft_consensus.cc:697] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 5 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:21.001869  8503 raft_consensus.cc:493] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.002275  8735 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.013698  8557 raft_consensus.cc:2804] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:21.067257  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:21.071138  7084 raft_consensus.cc:2468] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 5.
W20260709 12:27:21.058810  6980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.074043  7163 raft_consensus.cc:1240] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [term 7 LEADER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:27:21.072817  8650 consensus_queue.cc:1048] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:27:21.068187  8503 raft_consensus.cc:515] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:21.079551  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:21.037726  7128 leader_election.cc:304] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
W20260709 12:27:21.085685  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 48026.2us
I20260709 12:27:20.994305  8717 consensus_queue.cc:1048] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:27:21.025025  8111 raft_consensus.cc:493] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:21.101791  7204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.020490  8663 consensus_queue.cc:1059] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:27:21.073325  8557 raft_consensus.cc:493] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.986589  8726 raft_consensus.cc:515] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:21.081143  7010 raft_consensus.cc:1275] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:21.019229  8676 consensus_queue.cc:1059] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 12:27:21.019794  8649 consensus_queue.cc:1059] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:27:21.075985  8735 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:21.096645  8691 log.cc:927] Time spent T bbef1c76ff7d498c80d88abdea210535 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:27:21.099018  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:21.117985  7158 raft_consensus.cc:2393] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 6: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:21.118266  8574 consensus_queue.cc:237] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:21.109798  8742 log.cc:927] Time spent T 9456d7a00cec43ee9987067a28b4d6b8 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:27:21.120230  8676 raft_consensus.cc:3055] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:21.120702  8676 raft_consensus.cc:740] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:21.122519  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
    @     0x7f2875335a12 testing::Test::Run() at ??:0
I20260709 12:27:21.125401  8721 leader_election.cc:290] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:21.121555  8676 consensus_queue.cc:260] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:21.126175  6980 leader_election.cc:304] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:21.127246  8507 raft_consensus.cc:2804] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:21.112670  8750 raft_consensus.cc:2804] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:21.127796  8507 raft_consensus.cc:493] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.128006  8750 raft_consensus.cc:697] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:21.128201  8507 raft_consensus.cc:3060] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:21.019459  8505 consensus_queue.cc:237] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:21.129016  8750 consensus_queue.cc:237] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:21.109798  8736 log.cc:927] Time spent T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:27:21.110249  8714 raft_consensus.cc:493] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.112130  8580 leader_election.cc:290] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:21.024971  8730 consensus_queue.cc:1059] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:27:21.027541  8441 consensus_queue.cc:1059] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:27:21.095096  8711 raft_consensus.cc:2749] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:21.107664  8557 raft_consensus.cc:3060] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:21.116806  8575 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:21.081341  8587 consensus_queue.cc:1048] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:27:21.126636  8676 raft_consensus.cc:3060] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:20.984741  8722 consensus_queue.cc:260] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:21.029202  8667 consensus_queue.cc:237] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:21.143028  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 212984us
I20260709 12:27:21.130605  8663 consensus_queue.cc:1243] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer 022925662268440c91fff7e8732d7a0b log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:27:21.162732  7237 raft_consensus.cc:1275] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:27:21.163393  7237 pending_rounds.cc:85] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41: Aborting all ops after (but not including) 1
I20260709 12:27:21.163686  7237 pending_rounds.cc:107] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:27:21.163970  7237 raft_consensus.cc:2889] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:21.107772  8111 raft_consensus.cc:515] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:21.027623  8639 consensus_queue.cc:260] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:21.191463  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 274636us
I20260709 12:27:21.148936  8724 raft_consensus.cc:2749] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:21.214226  6982 leader_election.cc:304] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:21.150379  8726 leader_election.cc:290] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:21.216727  6982 leader_election.cc:304] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:21.219933  6982 leader_election.cc:304] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:21.221964  6982 leader_election.cc:304] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:21.223520  8411 raft_consensus.cc:3060] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:21.145465  8714 raft_consensus.cc:515] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:21.152534  8704 consensus_queue.cc:1048] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:27:21.229605  6982 leader_election.cc:304] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:21.267920  6982 leader_election.cc:304] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:21.256654  8732 raft_consensus.cc:493] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:21.257117  8741 log.cc:927] Time spent T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:27:21.223785  8455 raft_consensus.cc:2749] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:27:21.332440  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 60401.7us
I20260709 12:27:21.225473  8505 raft_consensus.cc:2749] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:21.231755  8746 log.cc:927] Time spent T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:27:21.232535  8724 raft_consensus.cc:2749] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:21.350823  7202 leader_election.cc:304] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:21.266453  8726 raft_consensus.cc:493] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.335438  8705 raft_consensus.cc:2749] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:21.340526  8734 raft_consensus.cc:493] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.366185  8455 raft_consensus.cc:493] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:21.373440  8455 raft_consensus.cc:515] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:21.375557  8455 leader_election.cc:290] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:21.376304  8631 raft_consensus.cc:3060] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:21.377563  8754 raft_consensus.cc:2749] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:21.383594  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:21.390530  7083 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 339) took 1154 ms. Trace:
I20260709 12:27:21.335728  8732 raft_consensus.cc:515] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:21.394836  8732 leader_election.cc:290] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:27:21.370148  7056 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.361594  8731 raft_consensus.cc:2749] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:21.361845  8587 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.420324  7131 leader_election.cc:304] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:21.360481  8726 raft_consensus.cc:515] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:21.455863  8726 leader_election.cc:290] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:21.436228  7163 raft_consensus.cc:1275] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:21.438014  7088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:21.439141  8667 consensus_queue.cc:1059] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:21.457330  8729 raft_consensus.cc:515] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:21.443038  8714 leader_election.cc:290] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:21.435397  8441 raft_consensus.cc:493] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:21.458561  7232 raft_consensus.cc:1240] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:21.458595  8441 raft_consensus.cc:515] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:21.369374  8734 raft_consensus.cc:515] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:21.460974  8441 leader_election.cc:290] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:21.444998  7054 leader_election.cc:304] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:21.445218  8411 raft_consensus.cc:2749] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:21.462218  7054 leader_election.cc:304] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:21.462559  8734 leader_election.cc:290] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:21.463335  8631 raft_consensus.cc:2749] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:21.464084  8631 raft_consensus.cc:2749] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:21.465052  7082 raft_consensus.cc:2410] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:21.465152  8721 consensus_queue.cc:1048] T 9456d7a00cec43ee9987067a28b4d6b8 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:21.466502  8668 consensus_queue.cc:1059] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:21.444918  8732 raft_consensus.cc:2804] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:21.467424  8732 raft_consensus.cc:697] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [term 5 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:21.467540  8668 raft_consensus.cc:3055] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:21.467905  8668 raft_consensus.cc:740] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:21.453667  8111 leader_election.cc:290] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:21.430655  8754 raft_consensus.cc:493] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.468307  8732 consensus_queue.cc:237] T 962a5b01fc1b4f9981e72dfd1f233aad P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:21.468806  8754 raft_consensus.cc:515] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:21.433030  8709 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:21.469758  8709 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:21.471279  8754 leader_election.cc:290] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:21.464352  7054 leader_election.cc:304] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:21.471915  8709 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:21.472044  8692 raft_consensus.cc:493] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.432883  8716 consensus_queue.cc:1048] T c6cce034dc624ce997cbf455d69ec9b2 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:27:21.472716  8692 raft_consensus.cc:515] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:21.474303  8753 log.cc:927] Time spent T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 12:27:21.458441  8369 consensus_queue.cc:1048] T a1a3ee09e96b456ebb64bb214205c697 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:27:21.476100  7054 leader_election.cc:304] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:21.476715  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:21.441627  8507 raft_consensus.cc:515] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:21.472487  8441 raft_consensus.cc:2804] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:21.487602  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:21.488358  7011 raft_consensus.cc:2368] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 5. Current term is 6.
I20260709 12:27:21.487706  7009 raft_consensus.cc:1275] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:21.489737  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:21.490317  7009 raft_consensus.cc:2468] T 5441bfff9f464980afe37a60473c5165 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:21.492738  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:21.493333  7009 raft_consensus.cc:2468] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:21.494791  7013 raft_consensus.cc:1240] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 LEADER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:21.496296  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:21.496225  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:21.497740  7009 raft_consensus.cc:2468] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:21.498030  7011 raft_consensus.cc:2468] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 2.
I20260709 12:27:21.391021  7083 rpcz_store.cc:276] 0709 12:27:20.235625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.357807 (+122182us) service_pool.cc:224] Handling call
0709 12:27:20.358155 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:20.595194 (+237039us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:27:20.798381 (+203187us) log.cc:844] Serialized 14 byte log entry
0709 12:27:21.107767 (+309386us) log.cc:844] Serialized 14 byte log entry
0709 12:27:21.138418 (+ 30651us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:21.146116 (+  7698us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:21.147418 (+  1302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:21.390289 (+242871us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54006d24d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:21.390337 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:21.390470 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26071,"prepare.queue_time_us":263142,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":73,"raft.queue_time_us":28274,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":6351,"spinlock_wait_cycles":463075712,"thread_start_us":438204,"threads_started":2,"wal-append.queue_time_us":355210}
I20260709 12:27:21.550374  7088 raft_consensus.cc:3055] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:21.550825  7088 raft_consensus.cc:740] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:21.506820  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:21.551529  7014 raft_consensus.cc:3060] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:21.506403  7091 raft_consensus.cc:3055] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:21.491421  8754 raft_consensus.cc:493] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.482643  8711 consensus_queue.cc:1048] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:27:21.549264  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9456d7a00cec43ee9987067a28b4d6b8" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:21.553633  7084 raft_consensus.cc:1275] T 2e8ea56c97614b3c978c9b2d55e10c1d P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:27:21.554188  7054 leader_election.cc:304] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:21.552697  7086 pending_rounds.cc:85] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca: Aborting all ops after (but not including) 2
I20260709 12:27:21.552374  7091 raft_consensus.cc:740] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:21.555012  7086 pending_rounds.cc:107] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:27:21.555267  7086 raft_consensus.cc:2889] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:21.436439  8587 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:21.497247  8441 raft_consensus.cc:697] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:21.485612  8668 consensus_queue.cc:260] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:21.551584  7088 consensus_queue.cc:260] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:21.574144  7085 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46238 (request call id 362) took 1355 ms (client timeout 1702 ms). Trace:
I20260709 12:27:21.564875  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:21.574646  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:21.499503  8406 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.498803  8721 raft_consensus.cc:2749] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:21.560204  8677 consensus_meta.cc:287] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.000s
I20260709 12:27:21.550670  8715 raft_consensus.cc:493] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.553155  8692 leader_election.cc:290] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:21.617377  7164 raft_consensus.cc:2468] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 5.
I20260709 12:27:21.569651  8729 leader_election.cc:290] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:21.619439  7233 raft_consensus.cc:3060] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:21.616219  8754 raft_consensus.cc:515] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:21.621320  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
W20260709 12:27:21.622556  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 68454.2us
W20260709 12:27:21.561085  8759 log.cc:927] Time spent T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:27:21.555585  7091 consensus_queue.cc:260] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:21.642535  7091 raft_consensus.cc:3060] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:21.567248  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:21.565404  8756 log.cc:927] Time spent T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:27:21.615471  7085 rpcz_store.cc:269] 0709 12:27:20.218406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.218887 (+   481us) service_pool.cc:224] Handling call
0709 12:27:21.573990 (+1355103us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54001c57d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:21.574089 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":910153472}
I20260709 12:27:21.626713  7238 raft_consensus.cc:1275] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:27:21.644667  7204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.624647  8663 raft_consensus.cc:2804] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:21.566387  8507 leader_election.cc:290] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:21.618631  7088 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:21.581890  8631 consensus_queue.cc:1048] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:27:21.625012  8406 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:21.635994  8503 leader_election.cc:290] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:21.643819  7016 raft_consensus.cc:2468] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:21.641933  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:21.655405  7237 raft_consensus.cc:2468] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 4.
I20260709 12:27:21.655961  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:21.656693  7016 raft_consensus.cc:2468] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
I20260709 12:27:21.630204  8668 raft_consensus.cc:3060] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:21.664410  7091 raft_consensus.cc:1275] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:27:21.664826  7091 pending_rounds.cc:85] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca: Aborting all ops after (but not including) 2
I20260709 12:27:21.664920  8587 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:21.623916  8735 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:21.632642  8715 raft_consensus.cc:515] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:21.667112  7082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46238 (request call id 364) took 1447 ms. Trace:
I20260709 12:27:21.667351  8735 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:21.667594  7082 rpcz_store.cc:276] 0709 12:27:20.219387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.229510 (+ 10123us) service_pool.cc:224] Handling call
0709 12:27:21.666903 (+1437393us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540070dd54. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:21.667049 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2563505408}
I20260709 12:27:21.670051  8715 leader_election.cc:290] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:21.670440  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:21.671573  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:21.672533  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:21.673141  7013 raft_consensus.cc:2468] T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:21.658562  8771 raft_consensus.cc:493] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:21.673815  8771 raft_consensus.cc:515] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:21.676435  8484 raft_consensus.cc:493] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.660136  8754 leader_election.cc:290] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:21.652055  8713 raft_consensus.cc:3060] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:21.656713  8557 consensus_meta.cc:287] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.003s
I20260709 12:27:21.646076  8663 raft_consensus.cc:493] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
W20260709 12:27:21.661698  8764 log.cc:927] Time spent T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:27:21.697316  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:21.697923  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:21.698621  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:21.699173  7237 raft_consensus.cc:2468] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:21.699864  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:21.663261  8406 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:21.641037  8441 consensus_queue.cc:237] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:21.702983  7055 leader_election.cc:304] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:21.665063  7091 pending_rounds.cc:107] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:27:21.673188  7088 raft_consensus.cc:1275] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:21.705545  7091 raft_consensus.cc:2889] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:21.636849  7014 raft_consensus.cc:2468] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 5.
I20260709 12:27:21.632230  7054 leader_election.cc:304] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:21.678308  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:21.685122  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2872784458984476909e30886ad094d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:21.685813  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:21.686529  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:21.687505  7202 leader_election.cc:304] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:21.676339  8771 leader_election.cc:290] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:21.704473  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:21.707261  7016 raft_consensus.cc:2393] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 3: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:21.700374  7230 raft_consensus.cc:2468] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:21.689201  8663 raft_consensus.cc:3060] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:21.707072  8721 raft_consensus.cc:2804] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:21.708992  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:21.706555  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:21.709702  7010 raft_consensus.cc:2468] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
W20260709 12:27:21.708009  8580 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:27:21.710096  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:21.709154  8721 raft_consensus.cc:493] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.677035  8484 raft_consensus.cc:515] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:21.710567  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:21.710748  7014 raft_consensus.cc:2468] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:21.712426  8484 leader_election.cc:290] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:21.710796  8721 raft_consensus.cc:3060] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:21.714833  7014 raft_consensus.cc:1240] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:27:21.704632  7238 raft_consensus.cc:1240] T 2872784458984476909e30886ad094d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:27:21.717697  7237 raft_consensus.cc:2468] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 2.
W20260709 12:27:21.718374  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 86197us
I20260709 12:27:21.719501  7054 leader_election.cc:400] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Vote denied by peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921) with higher term. Message: Invalid argument: T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 5. Current term is 6.
I20260709 12:27:21.719983  7054 leader_election.cc:403] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:27:21.720963  7013 raft_consensus.cc:2368] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 2. Current term is 3.
I20260709 12:27:21.720779  7014 raft_consensus.cc:1275] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:27:21.719545  7055 leader_election.cc:304] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:21.722234  7054 leader_election.cc:304] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:21.688750  8557 raft_consensus.cc:515] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:21.725020  7054 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:21.725831  8726 raft_consensus.cc:3060] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:21.726437  8667 raft_consensus.cc:2804] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:21.727479  8667 raft_consensus.cc:493] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.725582  8631 raft_consensus.cc:2804] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:21.727820  8667 raft_consensus.cc:3060] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:21.727916  8631 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:21.728358  8631 raft_consensus.cc:3060] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:21.734236  6980 leader_election.cc:304] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:21.736390  7205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.734760  8406 consensus_queue.cc:1048] T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:27:21.737115  8771 consensus_queue.cc:1048] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:21.738550  8771 raft_consensus.cc:2804] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:21.738940  8771 raft_consensus.cc:493] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:21.739306  8771 raft_consensus.cc:3060] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:21.744437  7233 raft_consensus.cc:2468] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 5.
I20260709 12:27:21.745911  8557 leader_election.cc:290] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:21.749471  8722 raft_consensus.cc:3060] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:21.757514  7233 raft_consensus.cc:1275] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:27:21.758168  7233 pending_rounds.cc:85] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41: Aborting all ops after (but not including) 1
I20260709 12:27:21.758556  7233 pending_rounds.cc:107] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:27:21.758862  7233 raft_consensus.cc:2889] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:21.752645  6980 leader_election.cc:304] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:21.774169  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:21.735641  8715 raft_consensus.cc:2749] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:21.726601  8668 raft_consensus.cc:2804] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:21.778595  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:21.779202  7086 raft_consensus.cc:1275] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:27:21.779651  7086 pending_rounds.cc:85] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca: Aborting all ops after (but not including) 2
I20260709 12:27:21.779919  7086 pending_rounds.cc:107] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:27:21.780220  7086 raft_consensus.cc:2889] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:21.765268  8346 raft_consensus.cc:493] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.767752  8724 raft_consensus.cc:2804] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:21.778801  8668 raft_consensus.cc:493] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.772001  8631 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:21.786309  8528 raft_consensus.cc:2804] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:21.787685  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:21.786283  8346 raft_consensus.cc:515] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:21.791033  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:21.804380  7087 raft_consensus.cc:1240] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [term 5 LEADER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:27:21.801985  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:21.802896  6982 leader_election.cc:304] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:21.803064  7013 raft_consensus.cc:1275] T b98e3324314348f5912ad5e8121127a8 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:21.806099  7086 raft_consensus.cc:1275] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:21.792461  8724 raft_consensus.cc:697] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:21.794126  8668 raft_consensus.cc:3060] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:21.812767  7054 leader_election.cc:400] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Vote denied by peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921) with higher term. Message: Invalid argument: T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 2. Current term is 3.
I20260709 12:27:21.822363  7054 leader_election.cc:403] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:27:21.805119  7011 raft_consensus.cc:2468] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 2.
W20260709 12:27:21.817860  8774 log.cc:927] Time spent T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:27:21.818781  8346 leader_election.cc:290] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:21.813755  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77b568a9d33646ddab98b1429efa026e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:21.822947  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:21.826922  7013 raft_consensus.cc:2468] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 5.
I20260709 12:27:21.823520  7202 leader_election.cc:304] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:21.814147  7082 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 6.
I20260709 12:27:21.811931  8506 consensus_queue.cc:1048] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:27:21.825181  8661 raft_consensus.cc:3060] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:21.814437  8507 consensus_queue.cc:1048] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:27:21.794471  8484 consensus_queue.cc:1048] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:27:21.828083  7202 leader_election.cc:304] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:21.811902  8686 raft_consensus.cc:493] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.793848  8663 raft_consensus.cc:515] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:21.840662  8398 raft_consensus.cc:493] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.843235  8667 raft_consensus.cc:515] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:21.843315  8398 raft_consensus.cc:515] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:21.830523  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:21.845391  8667 leader_election.cc:290] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:21.840507  8346 raft_consensus.cc:493] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:21.838220  8754 raft_consensus.cc:493] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:21.840893  8575 consensus_queue.cc:1048] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:21.847906  8346 raft_consensus.cc:515] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:21.847975  8754 raft_consensus.cc:515] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:21.850569  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:21.851214  8557 raft_consensus.cc:493] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:21.851722  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:21.851866  8686 raft_consensus.cc:515] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:21.850220  8346 leader_election.cc:290] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:21.851751  8557 raft_consensus.cc:515] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:21.854049  8686 leader_election.cc:290] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:21.854279  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:21.854904  7232 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:21.840526  8730 raft_consensus.cc:2804] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:21.845682  7089 raft_consensus.cc:1240] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:21.852388  7230 raft_consensus.cc:2468] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 6.
I20260709 12:27:21.844460  8663 leader_election.cc:290] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
W20260709 12:27:21.842379  7056 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:21.846983  8760 log.cc:927] Time spent T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.470s	user 0.002s	sys 0.000s
I20260709 12:27:21.845485  8398 leader_election.cc:290] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:21.847298  8693 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:21.853683  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:21.845400  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:21.839758  6982 leader_election.cc:304] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:21.841554  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:21.855815  8724 consensus_queue.cc:237] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:21.832269  8731 raft_consensus.cc:2804] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:21.855945  8557 leader_election.cc:290] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:21.826642  8729 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:21.861811  8730 raft_consensus.cc:493] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.823860  8694 consensus_queue.cc:1048] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 12:27:21.904335  7087 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:21.821595  8705 consensus_queue.cc:1048] T 2872784458984476909e30886ad094d8 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:27:21.906937  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:21.850193  8754 leader_election.cc:290] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:21.911177  7205 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:21.914955  8731 raft_consensus.cc:493] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.862233  8505 consensus_queue.cc:1048] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.067s
I20260709 12:27:21.956851  8731 raft_consensus.cc:3060] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:21.927711  7082 raft_consensus.cc:3060] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:21.914264  8398 raft_consensus.cc:493] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.913674  8730 raft_consensus.cc:3060] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:21.914049  7234 raft_consensus.cc:2468] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:21.950091  8677 raft_consensus.cc:2804] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:21.972364  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:21.949205  8754 raft_consensus.cc:493] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:21.975211  7230 raft_consensus.cc:3060] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:21.946085  8729 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:21.967447  8649 raft_consensus.cc:493] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.988715  8649 raft_consensus.cc:515] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:21.989382  8733 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:27:21.990880  8649 leader_election.cc:290] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
    @     0x7f2875336d29 testing::TestInfo::Run() at ??:0
I20260709 12:27:21.994346  8505 raft_consensus.cc:2749] T 77b568a9d33646ddab98b1429efa026e P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:21.973435  8667 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.978266  8677 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:22.007820  7082 raft_consensus.cc:2468] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:22.015074  7230 raft_consensus.cc:2468] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 5.
I20260709 12:27:22.016773  6980 leader_election.cc:304] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:22.015748  7055 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:21.974074  8398 raft_consensus.cc:515] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:22.039553  7238 raft_consensus.cc:1275] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:27:22.039969  7238 pending_rounds.cc:85] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41: Aborting all ops after (but not including) 3
I20260709 12:27:22.040257  7238 pending_rounds.cc:107] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:27:22.040649  7238 raft_consensus.cc:2889] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:22.039598  8398 leader_election.cc:290] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:22.055714  8771 raft_consensus.cc:515] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:22.031005  7232 raft_consensus.cc:2468] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 6.
I20260709 12:27:22.031899  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:27:22.033478  8776 log.cc:927] Time spent T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 12:27:22.035801  8780 log.cc:927] Time spent T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:27:22.015072  8667 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:22.036707  7054 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:22.030470  7130 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.014683  8677 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:21.983937  8754 raft_consensus.cc:515] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:22.082070  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 244120us
I20260709 12:27:22.014463  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
W20260709 12:27:22.097184  7130 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.026882  8733 raft_consensus.cc:2749] T f99919774f3a4dda86c7c90ad327b9bd P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:22.102849  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:22.103019  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:22.103991  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:22.110278  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:22.111352  7202 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.025476  8631 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:22.113070  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:22.115024  7082 raft_consensus.cc:2393] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 3: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:22.120720  8668 raft_consensus.cc:515] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:22.122488  7091 raft_consensus.cc:2393] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 3: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:22.111147  7015 raft_consensus.cc:2468] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 5.
I20260709 12:27:22.058131  8705 raft_consensus.cc:2749] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:22.077849  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:22.125665  7054 leader_election.cc:304] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:22.124290  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:22.132665  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:22.138062  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:22.138986  7165 raft_consensus.cc:2468] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:22.143131  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:22.145298  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:22.145910  7055 leader_election.cc:304] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:22.158645  7055 leader_election.cc:304] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:22.109205  8650 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.109452  8406 raft_consensus.cc:493] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:22.128999  8726 raft_consensus.cc:2749] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921) with higher term. Message: Invalid argument: T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 5. Current term is 6.
I20260709 12:27:22.174798  7086 raft_consensus.cc:1275] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:22.157305  7010 raft_consensus.cc:1240] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 3. Current term is 5. Ops: [3.2-3.2]
I20260709 12:27:22.128731  7083 raft_consensus.cc:2468] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 3.
I20260709 12:27:22.178794  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:22.145130  8575 raft_consensus.cc:2804] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:22.161247  8733 raft_consensus.cc:2749] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:22.157573  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:22.184631  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:22.166769  8513 raft_consensus.cc:2804] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:22.169296  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:22.189175  7234 raft_consensus.cc:2410] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for term 4 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:27:22.183530  8575 raft_consensus.cc:493] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.167315  8715 consensus_queue.cc:1048] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:27:22.169611  8650 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:22.174021  8406 raft_consensus.cc:515] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:22.199746  8744 log.cc:927] Time spent T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.973s	user 0.000s	sys 0.013s
I20260709 12:27:22.196585  7160 raft_consensus.cc:2468] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:22.208937  7162 raft_consensus.cc:1275] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:22.205011  8513 raft_consensus.cc:697] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [term 5 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:22.207885  7158 raft_consensus.cc:2468] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:22.294894  7087 raft_consensus.cc:2468] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 6.
I20260709 12:27:22.304587  8650 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:22.305601  8406 leader_election.cc:290] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:22.313472  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:22.314196  7158 raft_consensus.cc:2468] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:22.315133  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:22.315745  7158 raft_consensus.cc:3060] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:22.318509  8781 log.cc:927] Time spent T 3bdfdba2bae34156b0b852a03e5aa56f P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:27:22.320410  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:22.321190  7014 raft_consensus.cc:3060] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:22.321826  8787 log.cc:927] Time spent T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:27:22.323153  8528 raft_consensus.cc:493] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:22.219125  8772 raft_consensus.cc:2749] T 9456d7a00cec43ee9987067a28b4d6b8 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:22.323705  8528 raft_consensus.cc:3060] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:22.331056  8661 raft_consensus.cc:2749] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921) with higher term. Message: Invalid argument: T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 2. Current term is 3.
I20260709 12:27:22.332934  7083 raft_consensus.cc:1275] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:22.302426  8668 leader_election.cc:290] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:22.223500  8575 raft_consensus.cc:3060] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:22.368446  8754 leader_election.cc:290] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:22.369457  8661 raft_consensus.cc:493] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:22.377314  8661 raft_consensus.cc:515] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:22.378278  7156 raft_consensus.cc:2468] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 5.
I20260709 12:27:22.379400  7162 raft_consensus.cc:1275] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:22.379979  8661 leader_election.cc:290] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:22.336501  8721 consensus_meta.cc:287] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.623s	user 0.004s	sys 0.005s
I20260709 12:27:22.381206  8721 raft_consensus.cc:515] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:22.384531  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:22.385277  7012 raft_consensus.cc:3060] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:22.348405  7236 raft_consensus.cc:2468] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 6.
I20260709 12:27:22.355788  7164 raft_consensus.cc:2468] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:22.376003  7158 raft_consensus.cc:2468] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 5.
I20260709 12:27:22.361645  6980 leader_election.cc:304] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:22.342346  7014 raft_consensus.cc:2468] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:22.391932  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:22.392940  8783 raft_consensus.cc:2804] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:22.393401  8783 raft_consensus.cc:493] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:22.393879  8783 raft_consensus.cc:3060] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:22.397169  8754 consensus_queue.cc:1048] T b3af91840ca144a7b9595ccb5dfd4527 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:22.400506  7054 leader_election.cc:304] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:22.357076  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:22.402544  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:22.403247  7239 raft_consensus.cc:3060] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:22.348323  8677 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:22.413200  7088 raft_consensus.cc:1275] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:22.414422  7088 raft_consensus.cc:1240] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:22.414727  8677 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:22.344054  8786 raft_consensus.cc:493] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:22.415666  8786 raft_consensus.cc:515] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:22.415982  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:22.417423  8788 raft_consensus.cc:493] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:22.417750  8786 leader_election.cc:290] T f91790bef199456db685133d1c9f6fc2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:22.417970  8788 raft_consensus.cc:515] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:22.420012  8788 leader_election.cc:290] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:22.352459  8729 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:22.421455  8711 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.421972  8711 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:22.422290  8730 raft_consensus.cc:515] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:22.352385  8667 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:22.344393  8771 leader_election.cc:290] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:22.425057  8661 raft_consensus.cc:2804] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:22.349712  8513 consensus_queue.cc:237] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:22.425812  8661 raft_consensus.cc:697] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:22.427404  8661 consensus_queue.cc:237] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:22.428858  7235 raft_consensus.cc:1240] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:22.430060  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:22.431222  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:22.437089  7012 raft_consensus.cc:2468] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:22.440536  8721 leader_election.cc:290] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:22.445008  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:22.446358  7014 raft_consensus.cc:3060] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:22.442423  8730 leader_election.cc:290] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:22.451136  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:22.450987  8772 raft_consensus.cc:493] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:22.343772  8731 raft_consensus.cc:515] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
W20260709 12:27:22.473393  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 310811us
I20260709 12:27:22.478508  7014 raft_consensus.cc:2468] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 6.
I20260709 12:27:22.480393  8650 consensus_queue.cc:1048] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:22.484802  8406 consensus_queue.cc:1059] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:22.488642  7129 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:22.501163  7156 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56794 (request call id 334) took 1528 ms (client timeout 1586 ms). Trace:
I20260709 12:27:22.505008  7235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:22.505534  8724 consensus_queue.cc:1059] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:22.523898  8714 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:27:22.539633  7156 rpcz_store.cc:269] 0709 12:27:20.972541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.975272 (+  2731us) service_pool.cc:224] Handling call
0709 12:27:22.500868 (+1525596us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000fd554. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:22.501042 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2525571968}
I20260709 12:27:22.544535  7205 leader_election.cc:304] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:22.545683  7009 raft_consensus.cc:1275] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 12:27:22.547554  7054 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.548146  7014 raft_consensus.cc:1275] T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
W20260709 12:27:22.548211  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 59653us
I20260709 12:27:22.550159  7129 leader_election.cc:304] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:22.555459  7236 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49160 (request call id 303) took 1625 ms (client timeout 1846 ms). Trace:
I20260709 12:27:22.559158  6980 leader_election.cc:304] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:22.556056  7236 rpcz_store.cc:269] 0709 12:27:20.930579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.930960 (+   381us) service_pool.cc:224] Handling call
0709 12:27:22.555265 (+1624305us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540077a1d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:22.555397 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3176077184}
I20260709 12:27:22.551733  8557 raft_consensus.cc:2804] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:22.569001  6980 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:22.524665  8772 raft_consensus.cc:515] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:22.536495  8783 raft_consensus.cc:515] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:22.570586  8507 raft_consensus.cc:2804] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:22.557646  8406 raft_consensus.cc:2804] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:22.551126  8714 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:22.567785  8557 raft_consensus.cc:493] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.570996  8796 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.582922  8639 raft_consensus.cc:3060] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:22.564615  8503 raft_consensus.cc:2749] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:22.567387  8724 raft_consensus.cc:493] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.582115  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:22.612785  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:22.564652  8709 consensus_queue.cc:1059] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:27:22.563272  8522 consensus_queue.cc:1048] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:27:22.585314  8507 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:22.567934  8575 raft_consensus.cc:515] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:22.615738  8484 raft_consensus.cc:2804] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:27:21.639837  6968 catalog_manager.cc:6160] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974: Tablet 4db7053663484d018b4dcf9bfd77b330 (table test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]) was not created within the allowed timeout. Replacing with a new tablet 02785cd113ee41d6935f5dddac6f6dbd
I20260709 12:27:22.622154  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45f7bc068fdd4b51a0c353ae62350525" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:22.586916  8406 raft_consensus.cc:493] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.643164  8406 raft_consensus.cc:3060] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:22.644346  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
W20260709 12:27:22.645203  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:22.645246  7008 raft_consensus.cc:2393] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 3: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:22.612737  8557 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:22.648762  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:22.652330  8772 leader_election.cc:290] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:22.614822  8711 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:22.633600  7239 raft_consensus.cc:2468] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 5.
I20260709 12:27:22.618595  8724 raft_consensus.cc:515] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:22.658102  7159 raft_consensus.cc:1275] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:22.638377  8731 leader_election.cc:290] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:22.640846  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:22.661891  7082 raft_consensus.cc:1275] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 7 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:27:22.660418  8783 leader_election.cc:290] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:22.634747  8507 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:22.672623  8557 raft_consensus.cc:515] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:22.675016  8557 leader_election.cc:290] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 7 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:22.664494  8503 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:22.616282  8796 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:22.681095  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:22.683331  7090 raft_consensus.cc:2468] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 5.
I20260709 12:27:22.687960  6982 leader_election.cc:304] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:22.690307  8783 raft_consensus.cc:2804] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:22.690752  8783 raft_consensus.cc:493] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.691119  8783 raft_consensus.cc:3060] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:22.713754  7237 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49184 (request call id 251) took 1009 ms. Trace:
I20260709 12:27:22.719069  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:22.720057  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:22.714249  7237 rpcz_store.cc:276] 0709 12:27:21.704133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.704252 (+   119us) service_pool.cc:224] Handling call
0709 12:27:22.713557 (+1009305us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b5400567054. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:22.713688 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23238400}
I20260709 12:27:22.721035  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:22.721659  7014 raft_consensus.cc:2468] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 6.
I20260709 12:27:22.722111  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:22.722509  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "798483090bd74738a29fe018ce19422f" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:22.722970  7237 raft_consensus.cc:2468] T 0e1d204ca67b42f5812cea10c0ef8911 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:22.723609  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:22.724231  7009 raft_consensus.cc:3060] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:22.728408  7159 raft_consensus.cc:1275] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:22.729015  7008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:22.729918  7008 raft_consensus.cc:2468] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:22.731902  7237 raft_consensus.cc:1275] T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:22.685113  8503 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:22.737468  6980 leader_election.cc:304] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:22.738101  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:22.742735  7008 raft_consensus.cc:1275] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:22.757771  7014 raft_consensus.cc:1275] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 12:27:22.760386  6980 leader_election.cc:304] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:22.766824  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:22.767421  7014 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:22.770817  7009 raft_consensus.cc:2468] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:22.770195  8771 raft_consensus.cc:2804] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:27:22.773831  8801 log.cc:927] Time spent T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:27:22.775573  8772 raft_consensus.cc:2804] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:22.776048  8772 raft_consensus.cc:493] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:22.776427  8772 raft_consensus.cc:3060] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:22.779898  8503 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:22.781968  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:22.800719  7091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46252 (request call id 358) took 1023 ms. Trace:
I20260709 12:27:22.801311  7091 rpcz_store.cc:276] 0709 12:27:21.777861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.778028 (+   167us) service_pool.cc:224] Handling call
0709 12:27:22.792407 (+1014379us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b5400462154. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:22.800628 (+  8221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788718464}
I20260709 12:27:22.811280  8575 leader_election.cc:290] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:27:22.647730  6968 catalog_manager.cc:6160] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974: Tablet 0162f8268f134c95b5e6489ec3509b63 (table test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]) was not created within the allowed timeout. Replacing with a new tablet db991772f2fd43e4b0836447b8ab700b
I20260709 12:27:22.784512  8714 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:22.812397  8724 leader_election.cc:290] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:22.828933  8650 raft_consensus.cc:3055] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:22.829631  8650 raft_consensus.cc:740] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:22.830708  8650 consensus_queue.cc:260] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:22.787583  8503 raft_consensus.cc:493] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.834964  8503 raft_consensus.cc:515] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:22.788482  8771 raft_consensus.cc:697] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:22.853462  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:22.855840  7163 raft_consensus.cc:2393] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 4: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:22.855901  8724 consensus_queue.cc:1048] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:22.865566  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:22.867225  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3552ed8cab2344ef9bd713ff368c26da" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:22.868041  7011 raft_consensus.cc:3060] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:22.832297  8650 raft_consensus.cc:3060] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:22.873397  8822 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.874003  8822 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:22.877079  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:22.878639  8822 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:22.882848  7014 raft_consensus.cc:2468] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 7.
I20260709 12:27:22.883723  7159 raft_consensus.cc:2468] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:22.886323  8507 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:22.888197  7013 raft_consensus.cc:2468] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 6.
I20260709 12:27:22.894693  8772 raft_consensus.cc:515] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:22.895426  8796 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:22.896041  8528 consensus_meta.cc:287] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.572s	user 0.013s	sys 0.005s
W20260709 12:27:22.897770  7128 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.902061  8522 raft_consensus.cc:493] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.902143  8528 raft_consensus.cc:515] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:22.902789  7128 leader_election.cc:304] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:22.904264  7128 leader_election.cc:304] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:22.904875  8771 consensus_queue.cc:237] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:22.905983  8528 leader_election.cc:290] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:22.902685  8522 raft_consensus.cc:515] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:22.912328  7202 leader_election.cc:304] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:22.915422  8650 raft_consensus.cc:2804] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Leader pre-election won for term 3
    @     0x7f2875337d05 testing::TestSuite::Run() at ??:0
I20260709 12:27:22.919595  8783 raft_consensus.cc:515] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:22.969944  6980 leader_election.cc:304] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:22.971189  6980 leader_election.cc:304] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:22.971369  8783 leader_election.cc:290] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:22.972041  8724 raft_consensus.cc:2749] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:22.971987  8783 consensus_queue.cc:1048] T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:22.920419  8707 raft_consensus.cc:2804] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:22.921650  8729 raft_consensus.cc:2804] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:22.922482  8693 consensus_queue.cc:1048] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:22.930351  8522 leader_election.cc:290] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:22.938243  8815 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.940220  8503 leader_election.cc:290] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:22.917645  8731 raft_consensus.cc:493] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:22.944603  7129 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:22.944864  7204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.945230  8709 raft_consensus.cc:493] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:27:22.938234  6911 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48270 (request call id 72) took 13267 ms (client timeout 15000 ms). Trace:
I20260709 12:27:22.946147  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:22.994163  7088 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 363) took 1053 ms. Trace:
W20260709 12:27:22.997558  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 53079.7us
I20260709 12:27:22.998842  8731 raft_consensus.cc:515] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:22.999485  8819 raft_consensus.cc:2804] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:23.000365  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0162f8268f134c95b5e6489ec3509b63" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.000679  8819 raft_consensus.cc:697] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [term 6 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:23.001255  7085 raft_consensus.cc:2393] T 0162f8268f134c95b5e6489ec3509b63 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 4: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:23.001647  8667 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.002179  8667 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:23.002321  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.002208  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.003139  7086 raft_consensus.cc:2468] T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 6.
I20260709 12:27:23.003345  7090 raft_consensus.cc:2468] T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 7.
I20260709 12:27:23.001627  8731 leader_election.cc:290] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:23.004316  8667 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:23.007174  8729 raft_consensus.cc:697] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:23.008117  8729 consensus_queue.cc:237] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:23.010594  8707 raft_consensus.cc:493] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.011060  8707 raft_consensus.cc:3060] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:22.951407  8772 leader_election.cc:290] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:23.011672  8772 raft_consensus.cc:493] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:22.953570  7131 leader_election.cc:304] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:23.012336  8772 raft_consensus.cc:515] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
W20260709 12:27:23.012619  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 59153.4us
I20260709 12:27:23.012935  8709 raft_consensus.cc:515] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:23.013578  7010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 413) took 1512 ms. Trace:
I20260709 12:27:23.014490  8772 leader_election.cc:290] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:23.015232  8455 raft_consensus.cc:3055] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:23.015475  8818 raft_consensus.cc:2804] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:23.015152  8709 leader_election.cc:290] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:23.015750  8455 raft_consensus.cc:740] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:22.951825  8507 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:22.955854  8528 raft_consensus.cc:493] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:23.010685  7054 leader_election.cc:304] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
W20260709 12:27:22.991557  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 402810us
I20260709 12:27:23.018132  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:22.972851  8724 raft_consensus.cc:2804] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:23.019273  8724 raft_consensus.cc:697] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:23.020164  8724 consensus_queue.cc:237] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:23.020443  8815 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:23.018368  8484 raft_consensus.cc:493] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:23.021347  8484 raft_consensus.cc:3060] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:23.021899  8369 consensus_queue.cc:1048] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:22.972734  7008 raft_consensus.cc:1240] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:23.023806  8714 raft_consensus.cc:2804] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:23.024401  8714 raft_consensus.cc:697] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [term 4 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:22.997743  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:23.025292  8714 consensus_queue.cc:237] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:23.017185  8528 raft_consensus.cc:515] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:23.026261  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:23.027010  7091 raft_consensus.cc:2393] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 3: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:23.028929  8796 consensus_queue.cc:1048] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:23.027878  8528 leader_election.cc:290] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:23.029861  8528 raft_consensus.cc:493] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:23.030267  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:23.030339  8528 raft_consensus.cc:515] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:23.030947  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:22.957178  7203 leader_election.cc:304] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
W20260709 12:27:23.032272  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 75191.1us
I20260709 12:27:23.034354  8507 raft_consensus.cc:493] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:23.033941  7203 leader_election.cc:304] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:23.034888  7232 raft_consensus.cc:1240] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 4. Current term is 5. Ops: [4.2-4.2]
W20260709 12:27:22.974038  6968 catalog_manager.cc:6160] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974: Tablet c9220bb0b7044778bd5662989d6f5f2e (table test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]) was not created within the allowed timeout. Replacing with a new tablet b9ad72dfcfef4df3bd935a0bdadc8da6
I20260709 12:27:23.034904  8507 raft_consensus.cc:515] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:22.995236  8730 raft_consensus.cc:3055] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:23.037463  7161 raft_consensus.cc:1240] T d91aac6ef8734a52b667a6fd42f01635 P 022925662268440c91fff7e8732d7a0b [term 6 LEADER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:23.037892  8730 raft_consensus.cc:740] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:23.038365  7203 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:23.018635  7055 leader_election.cc:304] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:23.016739  8455 consensus_queue.cc:260] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:23.037943  8507 leader_election.cc:290] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:23.038856  8730 consensus_queue.cc:260] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:23.048774  8650 raft_consensus.cc:493] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.945947  8406 raft_consensus.cc:515] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:23.041004  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.043640  7055 leader_election.cc:304] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:23.049165  8730 raft_consensus.cc:3060] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:23.070936  7055 leader_election.cc:304] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:23.043843  8733 raft_consensus.cc:2804] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:23.072093  8733 raft_consensus.cc:493] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.072424  8733 raft_consensus.cc:3060] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:23.077018  8794 raft_consensus.cc:2749] T 0308ffb97aa94594bc22307383a7869b P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:23.078076  8794 raft_consensus.cc:2804] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:23.078547  8794 raft_consensus.cc:493] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:23.078940  8794 raft_consensus.cc:3060] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.079787  8528 leader_election.cc:290] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:23.081395  7055 leader_election.cc:304] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:23.082257  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:23.082480  8726 raft_consensus.cc:2804] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:23.082895  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:23.046474  7090 raft_consensus.cc:1240] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:23.083098  8726 raft_consensus.cc:493] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.084663  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:23.085054  8726 raft_consensus.cc:3060] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:23.085515  7238 raft_consensus.cc:3060] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:23.085760  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:23.047593  6968 catalog_manager.cc:6160] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974: Tablet aff8d600c9224a3089ef3ccecd0c25fd (table test-workload [id=cd269a389a5f415daa93e5e5ae04edaa]) was not created within the allowed timeout. Replacing with a new tablet 980b8120cc93471ebb74f173a9d1365b
I20260709 12:27:23.039417  7086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.001677  8819 consensus_queue.cc:237] T bfc2cfad86bb45cea81a8a9b6df167d8 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:23.051640  8406 leader_election.cc:290] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:23.096233  8406 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.096874  8406 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:23.098361  8823 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.098915  8823 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:23.099282  8406 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:23.055181  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55a320911224afdbff15fd96f57c211" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:23.103562  7236 raft_consensus.cc:3060] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:23.068221  8713 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.017s	sys 0.021s
W20260709 12:27:23.144748  8713 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.017s	sys 0.021s
I20260709 12:27:23.059976  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:23.060786  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:23.146447  7232 raft_consensus.cc:2393] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 3: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:23.063943  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:23.147953  7236 raft_consensus.cc:2468] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 7.
I20260709 12:27:23.149122  7011 raft_consensus.cc:2468] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 5.
I20260709 12:27:23.149669  7011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34210 (request call id 247) took 1045 ms. Trace:
I20260709 12:27:23.149947  7011 rpcz_store.cc:276] 0709 12:27:22.103914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.140840 (+ 36926us) service_pool.cc:224] Handling call
0709 12:27:22.867027 (+726187us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b58001b0698. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:23.149616 (+282589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8364416}
I20260709 12:27:23.066083  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:23.041638  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.065263  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:23.115537  7238 raft_consensus.cc:2468] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:23.123337  7202 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:23.053390  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:23.054106  8677 raft_consensus.cc:2804] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:23.053757  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:23.040784  8800 log.cc:927] Time spent T 0fafe7c9150d454fbf16d21df3231a53 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.566s	user 0.003s	sys 0.001s
I20260709 12:27:23.054165  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:23.055249  8693 raft_consensus.cc:2804] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:23.062543  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:22.997604  7088 rpcz_store.cc:276] 0709 12:27:21.940800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.415048 (+474248us) service_pool.cc:224] Handling call
0709 12:27:22.415363 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:22.430565 (+ 15202us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:27:22.442302 (+ 11737us) log.cc:844] Serialized 14 byte log entry
0709 12:27:22.699412 (+257110us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b48002f6358. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287d13daa1 00007f287d134b37 00007f287d1349ca 00007f287d22c26f 00007f287d22bf37 00007f287d24055c 00007f287d240508 00007f287d240488 00007f287d240443 00007f287d23f6ec 00007f287c169a96
0709 12:27:22.990359 (+290947us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:22.990974 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 12:27:22.991169 (+   195us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:22.991218 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:22.991307 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:22.993727 (+  2420us) raft_consensus.cc:1685] finished
0709 12:27:22.993859 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:22.994074 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":717730,"prepare.queue_time_us":12082,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":431528,"raft.run_cpu_time_us":3021,"raft.run_wall_time_us":259211,"spinlock_wait_cycles":3748224,"thread_start_us":141456,"threads_started":1,"wal-append.queue_time_us":231596}
W20260709 12:27:23.016337  6911 rpcz_store.cc:269] 0709 12:27:09.671190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.680671 (+  9481us) service_pool.cc:224] Handling call
0709 12:27:22.938162 (+13257491us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:19.420757 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:19.421355 (+   598us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:19.421401 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:27:19.421422 (+    21us) tablet.cc:662] Decoding operations
0709 12:27:19.422280 (+   858us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:19.422372 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:19.422404 (+    32us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:27:19.423080 (+   676us) tablet.cc:701] Row locks acquired
0709 12:27:19.423138 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:27:19.423331 (+   193us) write_op.cc:270] Start()
0709 12:27:19.423468 (+   137us) write_op.cc:276] Timestamp: P: 1783600039423272 usec, L: 0
0709 12:27:19.423505 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:27:19.424273 (+   768us) log.cc:844] Serialized 2848 byte log entry
0709 12:27:20.018885 (+594612us) op_driver.cc:464] REPLICATION: finished
0709 12:27:20.088540 (+ 69655us) write_op.cc:301] APPLY: starting
0709 12:27:20.088702 (+   162us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:20.089025 (+   323us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:20.089202 (+   177us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:20.090570 (+  1368us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:20.090923 (+   353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:27:20.091005 (+    82us) write_op.cc:312] APPLY: finished
0709 12:27:20.091509 (+   504us) log.cc:844] Serialized 58 byte log entry
0709 12:27:20.091739 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:20.091905 (+   166us) write_op.cc:454] Released schema lock
0709 12:27:20.091960 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:20.096154 (+  4194us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:20.096200 (+    46us) write_op.cc:454] Released schema lock
0709 12:27:20.685467 (+589267us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b540014a854. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f287821132a 00007f2878196f14 00007f2878196ec3 00007f2878196e38 00007f2878196df3 00007f28781960dc 00007f28781bfe16 00007f28781a7cbb 00007f287819239d 00007f2878195d75
Metrics: {"mutex_wait_us":151059,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":69284,"apply.run_cpu_time_us":3932,"apply.run_wall_time_us":3939,"num_ops":7,"prepare.queue_time_us":38937,"prepare.run_cpu_time_us":78028,"prepare.run_wall_time_us":235553,"raft.queue_time_us":216012,"raft.run_cpu_time_us":36101,"raft.run_wall_time_us":702025,"replication_time_us":595221,"spinlock_wait_cycles":80602880,"thread_start_us":526290,"threads_started":4,"wal-append.queue_time_us":296847,"wal-append.run_cpu_time_us":29394,"wal-append.run_wall_time_us":1372957}]]}
I20260709 12:27:23.014022  7010 rpcz_store.cc:276] 0709 12:27:21.501456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.712440 (+210984us) service_pool.cc:224] Handling call
0709 12:27:21.847379 (+134939us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:22.190318 (+342939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:23.011930 (+821612us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54003ef3d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:23.013387 (+  1457us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54003ef3d0. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782138ad 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:23.013518 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":891245568}
I20260709 12:27:23.045639  8455 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:23.049206  8650 raft_consensus.cc:3060] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.183534  8823 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:23.051728  8815 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:23.139995  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6874db0bed9045fcbd3a6bd63563221c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:23.189045  7089 raft_consensus.cc:3060] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:23.189868  8815 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.140498  7055 leader_election.cc:304] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:23.190960  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 50522.3us
I20260709 12:27:23.140691  8754 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:23.141108  8667 consensus_queue.cc:1048] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:23.141363  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.193827  7090 raft_consensus.cc:2468] T f0b3a1db65cd47d59e35e46159033163 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:23.141909  8668 consensus_queue.cc:1048] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:23.054250  8522 raft_consensus.cc:2749] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:23.142343  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8ea56c97614b3c978c9b2d55e10c1d" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.155040  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:23.157168  7157 raft_consensus.cc:2393] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 6: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:23.161432  7232 raft_consensus.cc:1275] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:27:23.196115  7232 pending_rounds.cc:85] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41: Aborting all ops after (but not including) 1
I20260709 12:27:23.196457  7232 pending_rounds.cc:107] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:27:23.196779  7232 raft_consensus.cc:2889] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:23.163834  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:23.197801  7236 raft_consensus.cc:3060] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:23.172968  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 47302.2us
I20260709 12:27:23.162717  8677 raft_consensus.cc:493] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.164824  8731 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.062666  8507 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:23.138275  8726 raft_consensus.cc:515] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:23.165170  7233 raft_consensus.cc:2468] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 6.
I20260709 12:27:23.163267  8557 consensus_queue.cc:1059] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:27:23.210969  7232 raft_consensus.cc:1275] T 3552ed8cab2344ef9bd713ff368c26da P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:23.215761  7082 raft_consensus.cc:1240] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:23.212230  7090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf21da8f96541e2b54dfd98b7f33342" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:23.231071  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:23.198407  8580 raft_consensus.cc:2804] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:23.191864  8693 raft_consensus.cc:697] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:23.232287  7239 raft_consensus.cc:1240] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 LEADER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:23.241008  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:23.193001  8815 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:23.241480  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdfdba2bae34156b0b852a03e5aa56f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:23.198851  8754 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:23.245648  7055 leader_election.cc:304] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:23.210706  8796 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:23.256353  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 241284us
I20260709 12:27:23.289276  7055 leader_election.cc:304] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:23.257454  6982 leader_election.cc:304] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
W20260709 12:27:23.290462  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 139049us
I20260709 12:27:23.262145  8677 raft_consensus.cc:3060] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:23.263926  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 357498us
I20260709 12:27:23.259167  8513 raft_consensus.cc:493] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:23.267204  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:23.242057  8503 raft_consensus.cc:493] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:23.296031  8503 raft_consensus.cc:515] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:23.298059  8503 leader_election.cc:290] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:23.268321  7164 raft_consensus.cc:2468] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 5.
I20260709 12:27:23.273113  8507 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:23.300678  8507 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:23.302281  8650 raft_consensus.cc:515] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:23.303130  8484 raft_consensus.cc:515] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:23.280344  8528 raft_consensus.cc:2804] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:23.306396  8484 leader_election.cc:290] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:23.307018  7157 raft_consensus.cc:2468] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:23.244122  8707 raft_consensus.cc:515] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:23.308095  8815 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:23.283794  8783 raft_consensus.cc:493] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.309859  8707 leader_election.cc:290] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:23.309787  8783 raft_consensus.cc:515] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:23.310470  8707 consensus_queue.cc:1048] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:23.311259  8726 leader_election.cc:290] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:23.311914  8783 leader_election.cc:290] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:23.312000  8825 raft_consensus.cc:3055] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:23.312587  8825 raft_consensus.cc:740] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:23.312942  8693 consensus_queue.cc:237] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:23.313378  8825 consensus_queue.cc:260] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:23.314762  8825 raft_consensus.cc:3060] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:23.273383  7236 raft_consensus.cc:2468] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:23.252234  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:23.268641  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.244387  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:23.230392  7089 raft_consensus.cc:2468] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 6.
W20260709 12:27:23.286298  7205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:23.253271  8818 raft_consensus.cc:697] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [term 4 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:23.255806  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.258757  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.291445  7055 leader_election.cc:304] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:23.291870  7088 raft_consensus.cc:1240] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:27:23.219799  8823 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.294651  7230 raft_consensus.cc:2468] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:23.294858  8772 raft_consensus.cc:2749] T 0162f8268f134c95b5e6489ec3509b63 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:23.295053  8714 raft_consensus.cc:2749] T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:23.295428  6982 leader_election.cc:304] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:23.318071  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:23.318694  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:23.261742  8785 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:23.339359  7163 raft_consensus.cc:2393] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 4: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:23.338549  7205 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:23.319418  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:23.318890  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:23.318862  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:23.321852  8754 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:23.258607  8733 raft_consensus.cc:515] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:23.284480  8580 raft_consensus.cc:493] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:23.315896  6980 leader_election.cc:304] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:23.338593  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:23.350278  7239 raft_consensus.cc:2393] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 4: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:23.341027  7232 raft_consensus.cc:2468] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 3.
I20260709 12:27:23.324108  8794 raft_consensus.cc:515] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:23.334122  7055 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:23.292871  8668 raft_consensus.cc:2749] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:27:23.346311  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 50961.2us
I20260709 12:27:23.273308  8731 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:23.357604  6982 leader_election.cc:304] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:23.359792  6980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 43970.8us
I20260709 12:27:23.366858  6980 leader_election.cc:304] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:23.368827  8507 raft_consensus.cc:2749] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:23.370991  8507 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.371564  8507 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:23.334867  8795 raft_consensus.cc:2749] T 6eb05e220cae466b9a2ef8f7d1565609 P 9e6e5c8ad44447588681b10df7ad79ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:23.293440  8796 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:23.368340  6980 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:23.378883  6982 leader_election.cc:304] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:23.341724  8729 raft_consensus.cc:2749] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:23.383747  6982 leader_election.cc:304] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:23.364421  7055 leader_election.cc:304] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:23.385550  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:23.360632  8754 raft_consensus.cc:2804] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:23.359006  8580 raft_consensus.cc:3060] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:23.377646  8505 raft_consensus.cc:2804] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:23.330261  8513 raft_consensus.cc:515] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:23.339624  8441 consensus_queue.cc:1048] T a537e9b5978b4b839c72ee655456c21f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 12:27:23.437654  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 79915.4us
W20260709 12:27:23.451452  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 157367us
I20260709 12:27:23.422685  7238 raft_consensus.cc:2468] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 5.
W20260709 12:27:23.442909  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 78794.3us
I20260709 12:27:23.400516  7086 raft_consensus.cc:2468] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 3.
I20260709 12:27:23.420178  8455 raft_consensus.cc:2804] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:23.365645  8398 raft_consensus.cc:2749] T c6cce034dc624ce997cbf455d69ec9b2 P 9e6e5c8ad44447588681b10df7ad79ca [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:23.446074  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 140762us
I20260709 12:27:23.341163  8823 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:23.375087  8783 raft_consensus.cc:2749] T 459d2d4cd4d0458fba1105fdc8dd504a P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:23.344920  8522 consensus_queue.cc:1059] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 12:27:23.352623  8709 consensus_queue.cc:1048] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 12:27:23.458958  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:23.462700  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:23.464356  7239 raft_consensus.cc:1240] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:23.464846  7164 raft_consensus.cc:1240] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:27:23.449054  8505 raft_consensus.cc:493] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.445818  8668 raft_consensus.cc:493] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:23.464721  7128 leader_election.cc:304] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:23.380110  8575 raft_consensus.cc:493] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:23.505899  7230 raft_consensus.cc:1275] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:23.417465  8503 raft_consensus.cc:2804] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:23.461503  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcce83ec14dc49a18368b15fa1535d92" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:23.375767  8715 consensus_queue.cc:1048] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 12:27:23.468349  7205 leader_election.cc:304] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:23.353400  8785 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:23.450475  8795 raft_consensus.cc:2804] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:23.445783  8754 raft_consensus.cc:493] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:27:23.513782  7204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:23.515766  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 63266us
I20260709 12:27:23.515837  7163 raft_consensus.cc:3060] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:23.516768  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 52124us
I20260709 12:27:23.529035  7128 leader_election.cc:304] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:23.450095  8650 leader_election.cc:290] T b98e3324314348f5912ad5e8121127a8 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:23.508834  7129 leader_election.cc:304] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:23.520689  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 52413.3us
I20260709 12:27:23.530788  7205 leader_election.cc:304] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:23.492107  8507 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:23.524781  7164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:23.504922  8505 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:23.516505  8503 raft_consensus.cc:493] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.539111  7164 raft_consensus.cc:2468] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 5.
I20260709 12:27:23.540311  7128 leader_election.cc:304] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:23.515221  8772 raft_consensus.cc:2749] T 2e8ea56c97614b3c978c9b2d55e10c1d P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:23.526592  8795 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:23.564487  6982 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 180807us
I20260709 12:27:23.532940  8522 raft_consensus.cc:2749] T 9cf21da8f96541e2b54dfd98b7f33342 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:23.533732  8754 raft_consensus.cc:3060] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:23.452165  8818 consensus_queue.cc:237] T 0162f8268f134c95b5e6489ec3509b63 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:23.561064  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 52317.6us
I20260709 12:27:23.559271  7163 raft_consensus.cc:2468] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 5.
I20260709 12:27:23.514907  8575 raft_consensus.cc:515] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:23.538431  8840 raft_consensus.cc:2749] T 798483090bd74738a29fe018ce19422f P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:23.514961  8668 raft_consensus.cc:515] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:23.566015  7131 leader_election.cc:304] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:23.548413  8503 raft_consensus.cc:3060] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:23.564762  8795 raft_consensus.cc:3060] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:23.563367  8730 raft_consensus.cc:2749] T 3bdfdba2bae34156b0b852a03e5aa56f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:23.577692  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:23.578388  7007 raft_consensus.cc:2468] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 4.
I20260709 12:27:23.576738  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:23.580369  8819 raft_consensus.cc:2804] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:23.580865  8819 raft_consensus.cc:493] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:23.581125  8824 log.cc:927] Time spent T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:27:23.581387  8668 leader_election.cc:290] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:23.582028  8829 log.cc:927] Time spent T 2e8ea56c97614b3c978c9b2d55e10c1d P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:27:23.581224  8819 raft_consensus.cc:3060] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:23.563783  8843 raft_consensus.cc:2749] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:23.584350  8823 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:27:23.585047  8835 log.cc:927] Time spent T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:27:23.585214  8731 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:23.570334  8709 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:23.586117  8709 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:23.588650  8406 raft_consensus.cc:2749] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:23.591809  8650 consensus_queue.cc:1048] T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:23.592329  7131 leader_election.cc:304] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:23.593940  8650 consensus_queue.cc:1048] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:23.594475  8794 leader_election.cc:290] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:23.569839  8713 raft_consensus.cc:2804] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:23.600485  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:23.601095  6980 leader_election.cc:304] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:23.584383  8785 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:23.588371  8709 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:23.619319  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:23.622493  7084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46248 (request call id 291) took 1520 ms. Trace:
I20260709 12:27:23.622881  7084 rpcz_store.cc:276] 0709 12:27:22.102473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.649803 (+547330us) service_pool.cc:224] Handling call
0709 12:27:22.650127 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:23.004760 (+354633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:23.004806 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:23.005379 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 12:27:23.258001 (+252622us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:23.258058 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:23.258167 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:23.622289 (+364122us) raft_consensus.cc:1685] finished
0709 12:27:23.622310 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:23.622432 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":354144,"raft.queue_time_us":354852,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":252253,"threads_started":1,"wal-append.queue_time_us":562172}
I20260709 12:27:23.624936  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:23.625082  7055 leader_election.cc:304] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:23.625602  7012 raft_consensus.cc:2468] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
W20260709 12:27:23.625885  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 55368us
I20260709 12:27:23.626957  7129 leader_election.cc:304] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:23.621771  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:23.628818  8557 raft_consensus.cc:2804] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:23.629354  7014 raft_consensus.cc:2393] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 4: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:23.618711  8853 raft_consensus.cc:2749] T f91790bef199456db685133d1c9f6fc2 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:23.622903  7011 raft_consensus.cc:2468] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 5.
I20260709 12:27:23.625933  8794 raft_consensus.cc:2804] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:23.629313  8557 raft_consensus.cc:697] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [term 4 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:23.629254  8369 consensus_queue.cc:1059] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:23.630617  8794 raft_consensus.cc:493] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.631099  8369 consensus_queue.cc:1243] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer e6a8a26eb5294e4cb87412a7f2698f41 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:27:23.631296  8557 consensus_queue.cc:237] T dd176d00420245edb709bcf50d2ce27b P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:23.633585  8668 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:23.634218  8844 raft_consensus.cc:3055] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:23.634176  8668 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:23.634651  8844 raft_consensus.cc:740] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:23.634958  7009 raft_consensus.cc:1275] T 3552ed8cab2344ef9bd713ff368c26da P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:23.635511  8844 consensus_queue.cc:260] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:23.631106  8794 raft_consensus.cc:3060] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:23.638397  7087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.639905  8713 raft_consensus.cc:697] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [term 7 LEADER]: Becoming Leader. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:23.640332  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.640851  8713 consensus_queue.cc:237] T e55a320911224afdbff15fd96f57c211 P 022925662268440c91fff7e8732d7a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:23.627352  7055 leader_election.cc:304] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:23.642135  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9573f07e2a9429cbf22a7bdc0413cb9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:23.642455  8715 raft_consensus.cc:2804] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:23.642724  7013 raft_consensus.cc:3060] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:23.642884  8715 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:23.643301  8715 raft_consensus.cc:3060] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:23.621208  7007 raft_consensus.cc:1275] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:27:23.645568  7014 raft_consensus.cc:1275] T 9cf21da8f96541e2b54dfd98b7f33342 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:23.619650  6980 leader_election.cc:304] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:23.657899  8507 raft_consensus.cc:3060] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:23.658411  6980 leader_election.cc:304] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:23.659408  8853 raft_consensus.cc:2804] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:23.659787  8853 raft_consensus.cc:493] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.659773  6980 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:23.660337  8853 raft_consensus.cc:3060] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:23.663496  8855 raft_consensus.cc:2749] T 807e3a465242486abefc80481a598bf9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:23.666980  7233 raft_consensus.cc:1240] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:23.668431  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:23.669087  7233 raft_consensus.cc:2468] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 5.
I20260709 12:27:23.669135  8853 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:23.670826  7233 raft_consensus.cc:1275] T 45f7bc068fdd4b51a0c353ae62350525 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:27:23.599982  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a537e9b5978b4b839c72ee655456c21f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:23.574504  8455 raft_consensus.cc:697] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:23.677726  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:23.678278  7202 leader_election.cc:304] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:23.681017  7230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:23.681658  7230 raft_consensus.cc:3060] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:27:23.682843  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:23.683617  7232 raft_consensus.cc:2393] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 4: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:23.683435  8785 consensus_queue.cc:1059] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:23.684355  6980 leader_election.cc:304] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:23.671306  8853 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:23.686546  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:23.678785  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 86531.7us
I20260709 12:27:23.602856  8733 leader_election.cc:290] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:23.615988  8843 raft_consensus.cc:2749] T aff8d600c9224a3089ef3ccecd0c25fd P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:23.691802  7202 leader_election.cc:304] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:23.636389  8668 leader_election.cc:290] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:23.704739  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.704882  7083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.706386  7091 raft_consensus.cc:2468] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 5.
I20260709 12:27:23.709090  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.710136  7085 raft_consensus.cc:2393] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 5: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:23.707016  7083 raft_consensus.cc:2468] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 6.
I20260709 12:27:23.602509  8815 consensus_queue.cc:1059] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 12:27:23.696262  8844 raft_consensus.cc:3060] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:23.695276  8507 raft_consensus.cc:2749] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:23.693307  8406 raft_consensus.cc:493] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:23.698052  8709 raft_consensus.cc:2804] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:23.718020  8522 raft_consensus.cc:2804] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:27:23.724961  7128 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 133988us
I20260709 12:27:23.727861  7230 raft_consensus.cc:2468] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 5.
I20260709 12:27:23.713424  8398 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.778173  6980 leader_election.cc:304] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:23.713846  8823 raft_consensus.cc:3055] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:27:23.772178  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 63707.8us
I20260709 12:27:23.677335  8714 consensus_queue.cc:1059] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:27:23.773496  7202 leader_election.cc:304] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
W20260709 12:27:23.770792  7129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 76533.1us
I20260709 12:27:23.697952  8855 raft_consensus.cc:493] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:23.778760  8406 raft_consensus.cc:515] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:23.706200  8796 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:23.784618  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:23.803470  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:23.804813  7163 raft_consensus.cc:1240] T dcce83ec14dc49a18368b15fa1535d92 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:27:23.774199  8709 raft_consensus.cc:493] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:23.782040  8733 consensus_queue.cc:1048] T 3552ed8cab2344ef9bd713ff368c26da P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:27:23.729326  8856 raft_consensus.cc:2804] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:23.787175  8815 consensus_queue.cc:1243] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer 9e6e5c8ad44447588681b10df7ad79ca log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:27:23.777158  8522 raft_consensus.cc:493] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:23.815812  7163 raft_consensus.cc:1240] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:23.773502  8731 consensus_queue.cc:1048] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:27:23.817312  7013 raft_consensus.cc:2468] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 6.
I20260709 12:27:23.791136  8823 raft_consensus.cc:740] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:23.797158  8507 raft_consensus.cc:2804] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:27:23.833765  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 115552us
W20260709 12:27:23.837270  8677 consensus_meta.cc:287] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.002s
I20260709 12:27:23.777536  8785 consensus_queue.cc:1048] T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:27:23.781772  8726 consensus_queue.cc:1048] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:27:23.802131  8848 raft_consensus.cc:2749] T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:23.822103  8709 raft_consensus.cc:3060] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:23.851137  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:23.801120  8455 consensus_queue.cc:237] T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:23.801843  8855 raft_consensus.cc:515] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:23.823292  8639 consensus_queue.cc:1059] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:27:23.873448  8855 leader_election.cc:290] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
    @     0x7f287534c7f5 testing::internal::UnitTestImpl::RunAllTests() at ??:0
I20260709 12:27:23.874640  7091 raft_consensus.cc:1240] T 6874db0bed9045fcbd3a6bd63563221c P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:27:23.867123  8693 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.829859  8796 consensus_queue.cc:1059] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:27:23.876158  8693 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:23.878400  8693 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:23.879498  8709 raft_consensus.cc:515] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:23.879681  8503 raft_consensus.cc:515] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:23.880769  8854 raft_consensus.cc:3055] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:23.881208  8854 raft_consensus.cc:740] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:23.882094  8854 consensus_queue.cc:260] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:23.882876  8709 leader_election.cc:290] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:23.883381  8854 raft_consensus.cc:3060] T 3bdfdba2bae34156b0b852a03e5aa56f P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:23.884678  8575 leader_election.cc:290] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:23.885381  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:23.885977  7013 raft_consensus.cc:3060] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:23.886507  8823 consensus_queue.cc:260] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:23.887653  8823 raft_consensus.cc:3060] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:23.846184  8507 raft_consensus.cc:697] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:23.833858  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:23.893915  7232 raft_consensus.cc:1275] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:23.835899  8441 raft_consensus.cc:493] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.832845  8522 raft_consensus.cc:3060] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:23.791774  8398 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:23.838810  8731 consensus_queue.cc:1243] T e76cdd025d4d4a159fa072347ced7f54 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer 2c146bd91ab94c5191365c34a414a5e6 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:27:23.927685  7203 leader_election.cc:304] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:23.913560  7054 leader_election.cc:304] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:23.825927  8856 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:23.895135  7013 raft_consensus.cc:2468] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 5.
I20260709 12:27:23.931363  8856 raft_consensus.cc:3060] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:23.906054  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.932582  7082 raft_consensus.cc:2410] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:27:23.933488  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:23.934587  7082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.938562  8639 consensus_queue.cc:1243] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer 2c146bd91ab94c5191365c34a414a5e6 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:27:23.911106  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308ffb97aa94594bc22307383a7869b" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:23.902395  8507 consensus_queue.cc:237] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:23.920918  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:23.869122  8677 raft_consensus.cc:515] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:23.924914  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:23.905203  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.978029  7091 raft_consensus.cc:2468] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 5.
W20260709 12:27:23.975625  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 62170.8us
I20260709 12:27:23.979885  6982 leader_election.cc:304] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b
I20260709 12:27:23.982344  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:23.983042  7009 raft_consensus.cc:2393] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 3: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:23.985025  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:23.986835  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:23.988937  7083 raft_consensus.cc:1275] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:23.985648  7014 raft_consensus.cc:2468] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:23.992115  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:23.939427  7202 leader_election.cc:304] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:23.939531  8825 consensus_meta.cc:287] T 45f7bc068fdd4b51a0c353ae62350525 P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.006s
I20260709 12:27:23.998543  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
W20260709 12:27:24.011507  7055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.68:38743, user_credentials={real_user=slave}} blocked reactor thread for 223665us
I20260709 12:27:24.000813  7131 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:24.012609  6982 leader_election.cc:304] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
W20260709 12:27:24.013942  7202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 74625.1us
I20260709 12:27:24.016731  7235 raft_consensus.cc:1240] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Rejecting Update request from peer 9e6e5c8ad44447588681b10df7ad79ca for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:27:24.018451  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:24.017311  6982 leader_election.cc:304] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:24.021059  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.021818  6982 leader_election.cc:304] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:23.944646  7013 pending_rounds.cc:85] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6: Aborting all ops after (but not including) 1
I20260709 12:27:24.023942  7013 pending_rounds.cc:107] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:27:24.024323  7013 raft_consensus.cc:2889] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:23.979271  8711 raft_consensus.cc:2749] T bbef1c76ff7d498c80d88abdea210535 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:23.909078  8667 consensus_queue.cc:1048] T 9cf21da8f96541e2b54dfd98b7f33342 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.108s
I20260709 12:27:23.903132  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76cdd025d4d4a159fa072347ced7f54" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:24.027972  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9b67ee02db405787e857725c431127" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:24.028782  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 101197us
I20260709 12:27:23.996778  8663 raft_consensus.cc:2804] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:23.896665  8794 raft_consensus.cc:515] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:23.999701  8785 raft_consensus.cc:2804] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:24.022620  8731 raft_consensus.cc:2804] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:24.046192  7165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6cce034dc624ce997cbf455d69ec9b2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.048796  7203 leader_election.cc:304] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:23.978612  8693 consensus_queue.cc:1059] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:27:23.978406  8709 consensus_queue.cc:1059] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:27:24.055487  7203 leader_election.cc:304] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:24.057334  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:24.026856  8852 raft_consensus.cc:2749] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:24.029297  8771 raft_consensus.cc:2804] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:24.037714  8845 raft_consensus.cc:2804] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:24.059110  7091 raft_consensus.cc:2468] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 5.
I20260709 12:27:23.912154  8441 raft_consensus.cc:515] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:24.029160  8853 raft_consensus.cc:2804] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:24.057969  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:24.070235  7159 raft_consensus.cc:2410] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:27:24.070784  7089 raft_consensus.cc:2468] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 6.
I20260709 12:27:24.016124  8849 consensus_queue.cc:1059] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:27:24.065949  7054 leader_election.cc:304] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
W20260709 12:27:24.089709  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:24.089455  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.062209  8711 raft_consensus.cc:2749] T 0308ffb97aa94594bc22307383a7869b P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:24.065294  8771 raft_consensus.cc:493] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.066049  8871 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:24.065611  8663 raft_consensus.cc:697] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
W20260709 12:27:24.097116  8505 consensus_meta.cc:287] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.003s
I20260709 12:27:24.039853  8795 raft_consensus.cc:515] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:24.067992  8845 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.087345  7203 leader_election.cc:304] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:24.073026  8785 raft_consensus.cc:697] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [term 6 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:24.075197  8853 raft_consensus.cc:493] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.120900  7157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.121766  7157 raft_consensus.cc:2468] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 6.
I20260709 12:27:24.101692  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa553cbc13e74e2b9dc7574c6008bd9f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:24.082499  8661 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:24.115723  7054 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.65:34921, user_credentials={real_user=slave}} blocked reactor thread for 49854.3us
I20260709 12:27:24.098402  8857 raft_consensus.cc:2749] T 8e234c90d1214131938d5c23c9ace832 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:24.104497  8883 raft_consensus.cc:3055] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:24.122700  7205 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:24.104473  8771 raft_consensus.cc:3060] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:24.131410  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:24.148308  7205 leader_election.cc:304] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:24.148914  7087 raft_consensus.cc:2393] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 5: Already voted for candidate 9e6e5c8ad44447588681b10df7ad79ca in this term.
I20260709 12:27:24.149121  7089 raft_consensus.cc:1240] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Rejecting Update request from peer 2c146bd91ab94c5191365c34a414a5e6 for earlier term 3. Current term is 4. Ops: []
W20260709 12:27:24.129091  8819 consensus_meta.cc:287] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b: Time spent flushing consensus metadata: real 0.544s	user 0.005s	sys 0.005s
I20260709 12:27:24.125090  8845 raft_consensus.cc:3060] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:24.156391  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459d2d4cd4d0458fba1105fdc8dd504a" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.124125  8853 raft_consensus.cc:3060] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:24.120873  8714 raft_consensus.cc:2804] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:24.248982  7088 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46252 (request call id 370) took 1036 ms. Trace:
I20260709 12:27:24.250378  7156 raft_consensus.cc:1275] T 92f8dcbe1b0441da8488ac2bd01c93fe P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:24.249684  7088 rpcz_store.cc:276] 0709 12:27:23.212655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.212789 (+   134us) service_pool.cc:224] Handling call
0709 12:27:23.213141 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:23.330618 (+117477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.248739 (+918121us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b54002035d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:24.248936 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180498176}
I20260709 12:27:24.136685  8883 raft_consensus.cc:740] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
W20260709 12:27:24.252888  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 114222us
I20260709 12:27:24.151497  8406 leader_election.cc:290] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:24.123019  8505 raft_consensus.cc:515] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:24.259573  7205 leader_election.cc:304] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:24.115582  8871 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:24.244598  7056 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:24.268824  8879 log.cc:927] Time spent T 6d4ca6181724464a84e2f73d387bb002 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:27:24.269270  8893 raft_consensus.cc:2749] T c6cce034dc624ce997cbf455d69ec9b2 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:24.269604  8872 log.cc:927] Time spent T a537e9b5978b4b839c72ee655456c21f P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 12:27:24.135476  8661 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:24.248930  8503 leader_election.cc:290] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:27:24.249557  8826 log.cc:927] Time spent T 0fafe7c9150d454fbf16d21df3231a53 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.121s	user 0.008s	sys 0.002s
I20260709 12:27:24.251658  8714 raft_consensus.cc:493] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
W20260709 12:27:24.287017  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 199773us
I20260709 12:27:24.249662  8693 consensus_queue.cc:1243] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer 022925662268440c91fff7e8732d7a0b log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:27:24.290318  7008 raft_consensus.cc:1240] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [term 8 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
W20260709 12:27:24.260028  8580 consensus_meta.cc:287] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.810s	user 0.004s	sys 0.008s
I20260709 12:27:24.292407  8580 raft_consensus.cc:515] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:24.258555  8873 raft_consensus.cc:493] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:24.293483  8505 leader_election.cc:290] T dc12a1d7cc98405390715e3d66ca06f7 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 8 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:24.265884  8398 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:24.293593  8873 raft_consensus.cc:515] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:24.288439  8857 raft_consensus.cc:2804] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:24.294763  8857 raft_consensus.cc:493] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.295140  8857 raft_consensus.cc:3060] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:24.295897  8873 leader_election.cc:290] T aff8d600c9224a3089ef3ccecd0c25fd P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:24.291250  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb05e220cae466b9a2ef8f7d1565609" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.297008  7085 raft_consensus.cc:1240] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:24.271371  8733 raft_consensus.cc:493] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e6a8a26eb5294e4cb87412a7f2698f41)
I20260709 12:27:24.290185  8714 raft_consensus.cc:3060] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:24.247951  8731 raft_consensus.cc:697] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 LEADER]: Becoming Leader. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:24.244722  8819 raft_consensus.cc:515] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:24.302785  8877 log.cc:927] Time spent T fa553cbc13e74e2b9dc7574c6008bd9f P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:27:24.303085  8819 leader_election.cc:290] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 4 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:24.304955  8661 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:24.308791  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:24.297513  8733 raft_consensus.cc:515] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:24.314131  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:24.288450  8677 leader_election.cc:290] T 2a631201d3d0438faa6efb30d0100608 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:24.315644  7234 raft_consensus.cc:1275] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:27:24.310410  8866 log.cc:927] Time spent T a537e9b5978b4b839c72ee655456c21f P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 12:27:24.266414  8663 consensus_queue.cc:237] T c9573f07e2a9429cbf22a7bdc0413cb9 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:24.313391  8891 raft_consensus.cc:2804] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:24.337221  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a631201d3d0438faa6efb30d0100608" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:24.338227  8733 leader_election.cc:290] T afc5926243c0439fb58fe23dcbd604a1 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:24.315066  8441 leader_election.cc:290] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:24.286800  8785 consensus_queue.cc:237] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:24.313862  8503 raft_consensus.cc:493] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:24.315663  8795 leader_election.cc:290] T 854ce637450c47bd8bc6a0a482a2f0c9 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:24.340845  7091 raft_consensus.cc:1240] T 5441bfff9f464980afe37a60473c5165 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:24.342245  7084 raft_consensus.cc:1240] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:24.314353  8693 raft_consensus.cc:2749] T fa553cbc13e74e2b9dc7574c6008bd9f P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:24.316365  8871 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:27:24.347728  8715 consensus_meta.cc:287] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca: Time spent flushing consensus metadata: real 0.704s	user 0.008s	sys 0.004s
I20260709 12:27:24.346453  8891 raft_consensus.cc:493] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.325438  8856 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:24.367579  7084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:24.373618  7007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:24.375216  7009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:24.375509  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:24.376446  7014 raft_consensus.cc:2468] T a1a3ee09e96b456ebb64bb214205c697 P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 3.
I20260709 12:27:24.379535  7014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:24.380734  7013 raft_consensus.cc:1275] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Refusing update from remote peer 9e6e5c8ad44447588681b10df7ad79ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:24.357826  8528 raft_consensus.cc:493] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.362006  8715 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:24.390938  7082 raft_consensus.cc:2468] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:24.392650  8507 consensus_queue.cc:1059] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:24.393651  8507 raft_consensus.cc:3055] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:24.393980  8507 raft_consensus.cc:740] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:24.394896  8507 consensus_queue.cc:260] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:24.362142  8731 consensus_queue.cc:237] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:24.398003  8843 raft_consensus.cc:3055] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:24.398597  8843 raft_consensus.cc:740] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:24.387058  8528 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:24.403674  7013 raft_consensus.cc:1240] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:24.396314  8507 raft_consensus.cc:3060] T 01d6818d6b1045378a6b8ace92ed2d7d P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:24.406621  8855 raft_consensus.cc:493] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:24.407380  8855 raft_consensus.cc:515] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:24.413260  7054 leader_election.cc:304] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 
I20260709 12:27:24.413419  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:24.362514  8891 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:24.414736  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:24.357584  8503 raft_consensus.cc:515] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:24.392248  8715 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
W20260709 12:27:24.421795  8835 log.cc:927] Time spent T d91aac6ef8734a52b667a6fd42f01635 P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:27:24.325079  8883 consensus_queue.cc:260] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:24.414196  8724 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.414415  8505 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
    @     0x7f2875358cd0 testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
I20260709 12:27:24.433157  8888 consensus_queue.cc:1048] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:27:24.425457  8522 raft_consensus.cc:515] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:24.430172  8580 leader_election.cc:290] T f445b9b3112b4c7d9c76e2f7cff0e129 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:24.434572  8856 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:24.435451  8503 leader_election.cc:290] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
W20260709 12:27:24.443763  8754 consensus_meta.cc:287] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 0.870s	user 0.005s	sys 0.004s
I20260709 12:27:24.444931  8855 leader_election.cc:290] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:24.446903  7158 raft_consensus.cc:1275] T f445b9b3112b4c7d9c76e2f7cff0e129 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:24.450637  8893 consensus_queue.cc:1059] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:24.399650  8843 consensus_queue.cc:260] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:24.454828  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc12a1d7cc98405390715e3d66ca06f7" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:24.423555  8871 raft_consensus.cc:2804] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:24.456298  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:24.499495  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bc42d22a1b4b3c9251c1ffceeb9a22" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:24.503129  7236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9220bb0b7044778bd5662989d6f5f2e" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:24.439486  8528 raft_consensus.cc:515] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:24.517876  8503 raft_consensus.cc:493] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.492818  8724 raft_consensus.cc:515] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:24.501217  8505 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:24.570616  7015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd176d00420245edb709bcf50d2ce27b" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:24.530696  8871 raft_consensus.cc:493] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:24.516671  8754 raft_consensus.cc:515] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:24.559600  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:24.578229  7163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.579739  8714 raft_consensus.cc:515] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:24.581110  7011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:24.581769  8823 consensus_meta.cc:287] T fa553cbc13e74e2b9dc7574c6008bd9f P 2c146bd91ab94c5191365c34a414a5e6: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.003s
I20260709 12:27:24.576049  8843 raft_consensus.cc:3060] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:24.582453  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
W20260709 12:27:24.578397  8898 log.cc:927] Time spent T dc12a1d7cc98405390715e3d66ca06f7 P 9e6e5c8ad44447588681b10df7ad79ca: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:27:24.576058  7013 raft_consensus.cc:2393] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 4: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:24.589691  7015 raft_consensus.cc:2468] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:24.568720  8441 raft_consensus.cc:493] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:24.596861  7236 raft_consensus.cc:2468] T c9220bb0b7044778bd5662989d6f5f2e P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 5.
I20260709 12:27:24.570946  8899 raft_consensus.cc:493] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:24.575896  8871 raft_consensus.cc:3060] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:24.593627  7016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:24.600592  7012 raft_consensus.cc:1240] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:24.575912  8398 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:24.599244  6980 leader_election.cc:304] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:24.604490  7128 leader_election.cc:304] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:24.605962  7238 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49174 (request call id 423) took 1468 ms (client timeout 1878 ms). Trace:
W20260709 12:27:24.606357  7238 rpcz_store.cc:269] 0709 12:27:23.137522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.154719 (+ 17197us) service_pool.cc:224] Handling call
0709 12:27:24.605809 (+1451090us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54006df6d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:24.605908 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522473856}
I20260709 12:27:24.584797  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98e3324314348f5912ad5e8121127a8" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:24.570420  8503 raft_consensus.cc:515] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:24.603124  8899 raft_consensus.cc:515] T 647e97c99a2a4c41a8f6e6570074411f P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:24.624449  8505 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:24.609611  8398 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:24.626539  8398 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:24.612499  8857 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:24.629536  8528 leader_election.cc:290] T 6d4ca6181724464a84e2f73d387bb002 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:24.630705  8522 leader_election.cc:290] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:24.630995  8857 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 6 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:24.631464  8724 leader_election.cc:290] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:24.612920  8839 raft_consensus.cc:2749] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:24.631841  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:24.637694  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:24.638696  7238 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 7.
I20260709 12:27:24.609151  8785 raft_consensus.cc:2804] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:24.640130  7091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:24.640748  7091 raft_consensus.cc:3060] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:24.640545  6980 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:24.644927  8505 raft_consensus.cc:2804] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:24.645354  8505 raft_consensus.cc:493] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.645705  8505 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:24.651176  7012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:24.651957  7012 raft_consensus.cc:3060] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:24.599668  8844 consensus_queue.cc:1059] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:27:24.654928  7091 raft_consensus.cc:2468] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 6.
I20260709 12:27:24.663209  7010 raft_consensus.cc:1240] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:27:24.663847  7056 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:24.632599  8771 raft_consensus.cc:515] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:24.663077  7089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca" is_pre_election: true
I20260709 12:27:24.599733  8441 raft_consensus.cc:515] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:24.664354  7010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6"
I20260709 12:27:24.670979  7007 raft_consensus.cc:2393] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 6: Already voted for candidate 2c146bd91ab94c5191365c34a414a5e6 in this term.
I20260709 12:27:24.675863  7010 raft_consensus.cc:1240] T c9573f07e2a9429cbf22a7bdc0413cb9 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 12:27:24.677142  7010 raft_consensus.cc:1240] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:24.679041  7010 raft_consensus.cc:1275] T e55a320911224afdbff15fd96f57c211 P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:27:24.684806  8771 leader_election.cc:290] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 6 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:24.690748  7009 raft_consensus.cc:1240] T e76cdd025d4d4a159fa072347ced7f54 P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:24.691485  7010 raft_consensus.cc:1275] T dd176d00420245edb709bcf50d2ce27b P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:24.692386  8369 raft_consensus.cc:3055] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:24.692832  8369 raft_consensus.cc:740] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:24.693701  8369 consensus_queue.cc:260] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:24.694943  8369 raft_consensus.cc:3060] T c9573f07e2a9429cbf22a7bdc0413cb9 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:24.698783  8503 leader_election.cc:290] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:24.702059  8513 leader_election.cc:290] T 2872784458984476909e30886ad094d8 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:24.702419  8871 raft_consensus.cc:515] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:24.702723  8505 raft_consensus.cc:515] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:24.706280  7012 raft_consensus.cc:2468] T 19b37dd1e304422ea7de68f81a21c0de P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
W20260709 12:27:24.709771  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:24.669804  8785 raft_consensus.cc:697] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [term 5 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:24.704450  8871 leader_election.cc:290] T a1a3ee09e96b456ebb64bb214205c697 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:24.715451  8484 raft_consensus.cc:3055] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:27:24.719244  8900 log.cc:927] Time spent T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:27:24.728168  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:24.728895  7233 raft_consensus.cc:3060] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:24.737047  7233 raft_consensus.cc:2468] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 8.
W20260709 12:27:24.738458  7086 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46238 (request call id 397) took 1718 ms (client timeout 2155 ms). Trace:
W20260709 12:27:24.738916  7086 rpcz_store.cc:269] 0709 12:27:23.020219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.039134 (+ 18915us) service_pool.cc:224] Handling call
0709 12:27:24.738296 (+1699162us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b540014ad54. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:24.738404 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707502464}
I20260709 12:27:24.738641  6980 leader_election.cc:304] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
I20260709 12:27:24.744846  8754 leader_election.cc:290] T d91aac6ef8734a52b667a6fd42f01635 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 7 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:24.746944  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "807e3a465242486abefc80481a598bf9" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:24.747510  7156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:24.749748  8853 raft_consensus.cc:515] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:24.750304  7158 raft_consensus.cc:1240] T 85bc42d22a1b4b3c9251c1ffceeb9a22 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Rejecting Update request from peer e6a8a26eb5294e4cb87412a7f2698f41 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:27:24.750435  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d4ca6181724464a84e2f73d387bb002" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:24.751071  7162 raft_consensus.cc:3060] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:24.751240  8714 leader_election.cc:290] T 2918b8da0cae441dae40ec77664c668c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Requested vote from peers 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:24.751806  8853 leader_election.cc:290] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 7 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:24.726082  8484 raft_consensus.cc:740] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:24.752583  8441 leader_election.cc:290] T bbef1c76ff7d498c80d88abdea210535 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:24.753412  8484 consensus_queue.cc:260] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:24.754513  8484 raft_consensus.cc:3060] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:24.756839  7011 raft_consensus.cc:2368] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b for earlier term 6. Current term is 7.
I20260709 12:27:24.759447  7162 raft_consensus.cc:2468] T 6d4ca6181724464a84e2f73d387bb002 P 022925662268440c91fff7e8732d7a0b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 7.
W20260709 12:27:24.749281  7203 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.200.67:39437 timed out after 1.582s (SENT) [suppressed 6 similar messages]
I20260709 12:27:24.758558  6968 catalog_manager.cc:5984] T 00000000000000000000000000000000 P 05f3d75cd2f646f485ea66030f036974: Sending DeleteTablet for 3 replicas of tablet 4db7053663484d018b4dcf9bfd77b330
I20260709 12:27:24.763031  8714 consensus_queue.cc:1048] T 409650d511434499a9f653d298a44c6b P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:24.764869  8891 raft_consensus.cc:515] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
W20260709 12:27:24.765523  8860 log.cc:927] Time spent T 45f7bc068fdd4b51a0c353ae62350525 P 2c146bd91ab94c5191365c34a414a5e6: Append to log took a long time: real 0.909s	user 0.003s	sys 0.000s
I20260709 12:27:24.758916  8848 raft_consensus.cc:493] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:24.768090  8848 raft_consensus.cc:515] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:24.769932  7157 raft_consensus.cc:1275] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:27:24.770344  7157 pending_rounds.cc:85] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b: Aborting all ops after (but not including) 2
I20260709 12:27:24.770604  7157 pending_rounds.cc:107] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:27:24.770107  8785 consensus_queue.cc:237] T c9220bb0b7044778bd5662989d6f5f2e P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:24.770815  7157 raft_consensus.cc:2889] T e76cdd025d4d4a159fa072347ced7f54 P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:24.771773  7085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e6e5c8ad44447588681b10df7ad79ca"
I20260709 12:27:24.772330  7085 raft_consensus.cc:3060] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:24.744488  8507 raft_consensus.cc:2804] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:24.773021  8507 raft_consensus.cc:697] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [term 8 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:24.773921  8507 consensus_queue.cc:237] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:24.777333  7076 tablet_service.cc:1558] Processing DeleteTablet for tablet 4db7053663484d018b4dcf9bfd77b330 with delete_type TABLET_DATA_DELETED (Replaced by 02785cd113ee41d6935f5dddac6f6dbd at 2026-07-09 12:27:22 UTC) from {username='slave'} at 127.0.0.1:46226
I20260709 12:27:24.739512  8845 raft_consensus.cc:515] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:24.782096  8891 leader_election.cc:290] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 7 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437)
I20260709 12:27:24.793502  7085 raft_consensus.cc:2468] T bfc2cfad86bb45cea81a8a9b6df167d8 P 9e6e5c8ad44447588681b10df7ad79ca [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6a8a26eb5294e4cb87412a7f2698f41 in term 7.
I20260709 12:27:24.797801  7156 raft_consensus.cc:2393] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e6a8a26eb5294e4cb87412a7f2698f41 in current term 6: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
W20260709 12:27:24.802039  7205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:24.790028  8505 leader_election.cc:290] T 5eb704d53a3841a4aae036013059732f P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 8 election: Requested vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:24.817276  8844 raft_consensus.cc:493] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:24.818097  8844 raft_consensus.cc:515] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:24.820734  8840 raft_consensus.cc:493] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.821303  8840 raft_consensus.cc:515] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:24.805354  8845 leader_election.cc:290] T 695b83e20b7a40e29be9f4c9b00baaaa P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 election: Requested vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:24.827508  7233 raft_consensus.cc:1275] T 854ce637450c47bd8bc6a0a482a2f0c9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:24.830205  8785 consensus_queue.cc:1048] T 854ce637450c47bd8bc6a0a482a2f0c9 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
    @     0x7f287534bdad testing::UnitTest::Run() at ??:0
    @           0x38839c RUN_ALL_TESTS() at /apache/dev/git/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:?
W20260709 12:27:24.844003  7203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.67:39437, user_credentials={real_user=slave}} blocked reactor thread for 94723.6us
W20260709 12:27:24.844857  7203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:24.845067  8840 leader_election.cc:290] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:24.848491  7203 leader_election.cc:304] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6
    @           0x386f9d main at /apache/dev/git/kudu/src/kudu/util/test_main.cc:?
I20260709 12:27:24.853724  7203 leader_election.cc:304] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e6a8a26eb5294e4cb87412a7f2698f41; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:24.850359  8844 leader_election.cc:290] T 0fafe7c9150d454fbf16d21df3231a53 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:24.854885  8730 consensus_queue.cc:1048] T 92f8dcbe1b0441da8488ac2bd01c93fe P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:27:24.854079  8891 raft_consensus.cc:2749] T 459d2d4cd4d0458fba1105fdc8dd504a P e6a8a26eb5294e4cb87412a7f2698f41 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:24.882500  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:24.883664  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.883236  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f91790bef199456db685133d1c9f6fc2" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
W20260709 12:27:24.890273  6961 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:24.862799  8711 raft_consensus.cc:2749] T 6eb05e220cae466b9a2ef8f7d1565609 P e6a8a26eb5294e4cb87412a7f2698f41 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:24.895392  7055 leader_election.cc:304] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
W20260709 12:27:24.896716  7130 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:24.897854  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.898751  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.902225  8663 raft_consensus.cc:2804] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:24.902842  8663 raft_consensus.cc:697] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [term 5 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:24.903311  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b3a1db65cd47d59e35e46159033163" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:24.904879  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.905627  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.906288  7158 raft_consensus.cc:2468] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 4.
I20260709 12:27:24.886739  8861 consensus_queue.cc:1048] T f445b9b3112b4c7d9c76e2f7cff0e129 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:27:24.908442  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e234c90d1214131938d5c23c9ace832" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.909806  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:24.910151  7159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.911463  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91aac6ef8734a52b667a6fd42f01635" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:24.918684  7159 raft_consensus.cc:2393] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c146bd91ab94c5191365c34a414a5e6 in current term 4: Already voted for candidate 022925662268440c91fff7e8732d7a0b in this term.
I20260709 12:27:24.921800  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db7053663484d018b4dcf9bfd77b330" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:24.922549  7161 raft_consensus.cc:3060] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:27:24.932626  7161 raft_consensus.cc:2468] T 4db7053663484d018b4dcf9bfd77b330 P 022925662268440c91fff7e8732d7a0b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 7.
I20260709 12:27:24.907464  8918 tablet_replica.cc:333] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca: stopping tablet replica
I20260709 12:27:24.933841  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.936192  7158 raft_consensus.cc:2468] T e4be0c7ab6814c10832dad40146ef05c P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:24.934291  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.938359  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d6818d6b1045378a6b8ace92ed2d7d" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:24.939036  7158 raft_consensus.cc:3060] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:24.940533  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.941478  7160 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56794 (request call id 357) took 1087 ms. Trace:
I20260709 12:27:24.941844  7160 rpcz_store.cc:276] 0709 12:27:23.854388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.871253 (+ 16865us) service_pool.cc:224] Handling call
0709 12:27:24.940370 (+1069117us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b5800004298. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f2874fafdb1 00007f28750efb71 00007f28750efa22 00007f287e0088d9 00007f287d162ee0 00007f287d22c0ab 00007f287d22c131 00007f287d1da0a0 00007f287d1d9984 00007f28767546d4 00007f2876754662
0709 12:27:24.941411 (+  1041us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91353856}
I20260709 12:27:24.937608  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b37dd1e304422ea7de68f81a21c0de" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:24.946797  7161 raft_consensus.cc:2368] T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4.
I20260709 12:27:24.951058  7158 raft_consensus.cc:2468] T 01d6818d6b1045378a6b8ace92ed2d7d P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:24.952298  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.904027  8663 consensus_queue.cc:237] T dcce83ec14dc49a18368b15fa1535d92 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:24.956395  7160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "962a5b01fc1b4f9981e72dfd1f233aad" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.967726  7055 leader_election.cc:304] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:24.969525  7055 leader_election.cc:304] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:24.971267  7055 leader_election.cc:400] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Vote denied by peer 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437) with higher term. Message: Invalid argument: T 19b37dd1e304422ea7de68f81a21c0de P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 3. Current term is 4.
I20260709 12:27:24.971639  7055 leader_election.cc:403] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:27:24.972872  7055 leader_election.cc:304] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca; no voters: 2c146bd91ab94c5191365c34a414a5e6
I20260709 12:27:24.964933  6980 leader_election.cc:304] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:24.987079  6980 leader_election.cc:304] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, 9e6e5c8ad44447588681b10df7ad79ca
I20260709 12:27:24.990276  7161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "647e97c99a2a4c41a8f6e6570074411f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:24.990715  6980 leader_election.cc:304] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:24.995074  6980 leader_election.cc:304] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:24.981880  8715 raft_consensus.cc:2749] T 695b83e20b7a40e29be9f4c9b00baaaa P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:24.983546  8795 raft_consensus.cc:2804] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:24.992312  8455 raft_consensus.cc:2749] T 2918b8da0cae441dae40ec77664c668c P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:25.005478  7087 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46248 (request call id 301) took 1367 ms. Trace:
I20260709 12:27:25.005973  7087 rpcz_store.cc:276] 0709 12:27:23.637920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.638142 (+   222us) service_pool.cc:224] Handling call
0709 12:27:25.005238 (+1367096us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54005046d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782182fa 00007f287d1d9b17 00007f28767546d4 00007f2876754662 00007f2876754591 00007f287675450c 00007f28767537c2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:25.005401 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1146800512}
I20260709 12:27:25.008486  7008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34216 (request call id 440) took 1434 ms. Trace:
I20260709 12:27:25.008941  7008 rpcz_store.cc:276] 0709 12:27:23.574013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.574136 (+   123us) service_pool.cc:224] Handling call
0709 12:27:23.574528 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:24.298487 (+723959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.008200 (+709713us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b540079d1d4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:25.008420 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1645624192}
I20260709 12:27:24.989962  8726 raft_consensus.cc:2804] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:25.028903  8726 raft_consensus.cc:697] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [term 4 LEADER]: Becoming Leader. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:25.029825  8726 consensus_queue.cc:237] T 01d6818d6b1045378a6b8ace92ed2d7d P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:25.031172  8856 raft_consensus.cc:493] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.031807  8856 raft_consensus.cc:515] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:25.001888  7055 leader_election.cc:304] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e6e5c8ad44447588681b10df7ad79ca; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:24.984045  8796 raft_consensus.cc:3060] T 19b37dd1e304422ea7de68f81a21c0de P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:25.034109  8856 leader_election.cc:290] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:24.981128  8580 raft_consensus.cc:493] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.036862  8580 raft_consensus.cc:515] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:25.037850  7014 raft_consensus.cc:1240] T 962a5b01fc1b4f9981e72dfd1f233aad P 2c146bd91ab94c5191365c34a414a5e6 [term 6 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:25.039147  8580 leader_election.cc:290] T c9220bb0b7044778bd5662989d6f5f2e P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:25.039728  8580 raft_consensus.cc:2749] T 647e97c99a2a4c41a8f6e6570074411f P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:25.000715  6980 leader_election.cc:304] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:25.040266  7235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49184 (request call id 262) took 1978 ms. Trace:
I20260709 12:27:24.999132  8785 raft_consensus.cc:2749] T 1f0c1fabae4b45f5a06cac8289e281ab P 2c146bd91ab94c5191365c34a414a5e6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:25.041632  8785 raft_consensus.cc:2749] T 8e234c90d1214131938d5c23c9ace832 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:25.002370  8507 raft_consensus.cc:2749] T f0b3a1db65cd47d59e35e46159033163 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:25.041986  6980 leader_election.cc:304] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 022925662268440c91fff7e8732d7a0b, 2c146bd91ab94c5191365c34a414a5e6; no voters: 
I20260709 12:27:25.045456  7232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49174 (request call id 432) took 1177 ms. Trace:
I20260709 12:27:25.046046  7232 rpcz_store.cc:276] 0709 12:27:23.868423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.868644 (+   221us) service_pool.cc:224] Handling call
0709 12:27:23.869044 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:23.894414 (+ 25370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.045126 (+1150712us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b54003fc854. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:25.045362 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56178560}
I20260709 12:27:25.047705  8668 raft_consensus.cc:3055] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:25.048185  8668 raft_consensus.cc:740] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e6e5c8ad44447588681b10df7ad79ca, State: Running, Role: LEADER
I20260709 12:27:25.049131  8668 consensus_queue.cc:260] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
I20260709 12:27:25.050326  8668 raft_consensus.cc:3060] T b98e3324314348f5912ad5e8121127a8 P 9e6e5c8ad44447588681b10df7ad79ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:25.024514  8794 leader_election.cc:290] T 92f8dcbe1b0441da8488ac2bd01c93fe P 9e6e5c8ad44447588681b10df7ad79ca [CANDIDATE]: Term 6 election: Requested vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
I20260709 12:27:25.004416  8754 raft_consensus.cc:2804] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:25.053171  8754 raft_consensus.cc:493] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.053614  8754 raft_consensus.cc:3060] T d6eb6cab9bda4770b44ece4d2a9351eb P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:25.054967  8650 raft_consensus.cc:493] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2c146bd91ab94c5191365c34a414a5e6)
I20260709 12:27:25.011750  8795 raft_consensus.cc:493] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 022925662268440c91fff7e8732d7a0b)
I20260709 12:27:25.055754  8650 raft_consensus.cc:515] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:25.056380  8795 raft_consensus.cc:3060] T e4be0c7ab6814c10832dad40146ef05c P 9e6e5c8ad44447588681b10df7ad79ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:25.056649  7149 tablet_service.cc:1558] Processing DeleteTablet for tablet 4db7053663484d018b4dcf9bfd77b330 with delete_type TABLET_DATA_DELETED (Replaced by 02785cd113ee41d6935f5dddac6f6dbd at 2026-07-09 12:27:22 UTC) from {username='slave'} at 127.0.0.1:56774
I20260709 12:27:25.058650  8650 leader_election.cc:290] T b3af91840ca144a7b9595ccb5dfd4527 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:25.059460  8507 raft_consensus.cc:2804] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:25.060016  8507 raft_consensus.cc:697] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [term 7 LEADER]: Becoming Leader. State: Replica: 2c146bd91ab94c5191365c34a414a5e6, State: Running, Role: LEADER
I20260709 12:27:25.060923  8507 consensus_queue.cc:237] T 4db7053663484d018b4dcf9bfd77b330 P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } }
W20260709 12:27:25.015547  8919 log.cc:927] Time spent T f0b3a1db65cd47d59e35e46159033163 P 022925662268440c91fff7e8732d7a0b: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:27:25.052980  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f99919774f3a4dda86c7c90ad327b9bd" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:25.055051  8840 raft_consensus.cc:493] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e6e5c8ad44447588681b10df7ad79ca)
I20260709 12:27:25.062824  7157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56794 (request call id 356) took 1208 ms. Trace:
I20260709 12:27:25.073066  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4be0c7ab6814c10832dad40146ef05c" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:25.029891  8861 consensus_queue.cc:1059] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:25.075568  8861 raft_consensus.cc:3055] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:25.075896  8861 raft_consensus.cc:740] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e6a8a26eb5294e4cb87412a7f2698f41, State: Running, Role: LEADER
I20260709 12:27:25.076113  7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:25.040879  7235 rpcz_store.cc:276] 0709 12:27:23.061392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.061526 (+   134us) service_pool.cc:224] Handling call
0709 12:27:23.061936 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:24.022294 (+960358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.039955 (+1017661us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b54006dfbd4. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f2878214e01 00007f287821383e 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6
0709 12:27:25.040195 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2195235072}
I20260709 12:27:25.018078  8870 raft_consensus.cc:3055] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:25.079949  7234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "695b83e20b7a40e29be9f4c9b00baaaa" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:25.080296  8918 raft_consensus.cc:2243] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.080453  8870 raft_consensus.cc:740] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 022925662268440c91fff7e8732d7a0b, State: Running, Role: LEADER
I20260709 12:27:25.080816  7234 raft_consensus.cc:2393] T 695b83e20b7a40e29be9f4c9b00baaaa P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 022925662268440c91fff7e8732d7a0b in current term 6: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:25.081130  8918 raft_consensus.cc:2272] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.081445  8870 consensus_queue.cc:260] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } }
I20260709 12:27:25.082042  7236 raft_consensus.cc:1275] T e55a320911224afdbff15fd96f57c211 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:27:25.067741  7238 raft_consensus.cc:1240] T 7a9b67ee02db405787e857725c431127 P e6a8a26eb5294e4cb87412a7f2698f41 [term 5 LEADER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:25.068967  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d204ca67b42f5812cea10c0ef8911" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:25.083455  7165 raft_consensus.cc:1275] T 6874db0bed9045fcbd3a6bd63563221c P 022925662268440c91fff7e8732d7a0b [term 6 FOLLOWER]: Refusing update from remote peer 2c146bd91ab94c5191365c34a414a5e6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:25.070726  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fafe7c9150d454fbf16d21df3231a53" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:25.083985  6980 leader_election.cc:304] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6; no voters: 022925662268440c91fff7e8732d7a0b, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:25.084817  8823 raft_consensus.cc:2749] T 0e1d204ca67b42f5812cea10c0ef8911 P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:25.073881  7239 raft_consensus.cc:2468] T e4be0c7ab6814c10832dad40146ef05c P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 022925662268440c91fff7e8732d7a0b in term 4.
I20260709 12:27:25.085341  8861 consensus_queue.cc:260] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:25.074878  8783 raft_consensus.cc:493] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.073568  7157 rpcz_store.cc:276] 0709 12:27:23.854088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.129301 (+275213us) service_pool.cc:224] Handling call
0709 12:27:24.769577 (+640276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:24.771270 (+  1693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.062521 (+291251us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b54007ebdd0. stack: 00007f28750f5343 00007f28750f5240 00007f2874a841d4 00007f287e7c2304 00007f287e7c2299 00007f287817d571 00007f28782138ad 00007f287d1d8419 00007f287674fbd4 00007f287674fb62 00007f287674fa91 00007f287674fa0c 00007f287674ecc2 00007f287654f48c 00007f287654e8c6 00007f287654e26f
0709 12:27:25.062733 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1417504512}
I20260709 12:27:25.080058  8794 consensus_queue.cc:1059] T 2a631201d3d0438faa6efb30d0100608 P 9e6e5c8ad44447588681b10df7ad79ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:27:25.086382  8783 raft_consensus.cc:515] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } } peers { permanent_uuid: "2c146bd91ab94c5191365c34a414a5e6" member_type: VOTER last_known_addr { host: "127.3.200.65" port: 34921 } } peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } }
I20260709 12:27:25.087870  8848 leader_election.cc:290] T 1f0c1fabae4b45f5a06cac8289e281ab P e6a8a26eb5294e4cb87412a7f2698f41 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 022925662268440c91fff7e8732d7a0b (127.3.200.67:39437), 2c146bd91ab94c5191365c34a414a5e6 (127.3.200.65:34921)
I20260709 12:27:25.087606  8870 raft_consensus.cc:3060] T 7a9b67ee02db405787e857725c431127 P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:25.086601  8861 raft_consensus.cc:3060] T dc12a1d7cc98405390715e3d66ca06f7 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:25.084342  8918 ts_tablet_manager.cc:1916] T 4db7053663484d018b4dcf9bfd77b330 P 9e6e5c8ad44447588681b10df7ad79ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260709 12:27:25.089134  8783 leader_election.cc:290] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743), 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713)
I20260709 12:27:25.089334  8883 raft_consensus.cc:3060] T dcce83ec14dc49a18368b15fa1535d92 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:25.073809  7232 raft_consensus.cc:1240] T 807e3a465242486abefc80481a598bf9 P e6a8a26eb5294e4cb87412a7f2698f41 [term 6 FOLLOWER]: Rejecting Update request from peer 022925662268440c91fff7e8732d7a0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:25.091688  8852 consensus_queue.cc:1048] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:25.092314  8852 consensus_queue.cc:1243] T 6874db0bed9045fcbd3a6bd63563221c P 2c146bd91ab94c5191365c34a414a5e6 [LEADER]: Peer 022925662268440c91fff7e8732d7a0b log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:27:25.093089  7233 raft_consensus.cc:1275] T dd176d00420245edb709bcf50d2ce27b P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Refusing update from remote peer 022925662268440c91fff7e8732d7a0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:25.091784  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409650d511434499a9f653d298a44c6b" candidate_uuid: "2c146bd91ab94c5191365c34a414a5e6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:25.095234  7232 raft_consensus.cc:2468] T 409650d511434499a9f653d298a44c6b P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c146bd91ab94c5191365c34a414a5e6 in term 4.
I20260709 12:27:25.096617  6980 leader_election.cc:304] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c146bd91ab94c5191365c34a414a5e6, e6a8a26eb5294e4cb87412a7f2698f41; no voters: 
W20260709 12:27:25.104970  7131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 149714us
I20260709 12:27:25.096478  8840 raft_consensus.cc:515] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e6e5c8ad44447588681b10df7ad79ca" member_type: VOTER last_known_addr { host: "127.3.200.66" port: 36713 } } peers { permanent_uuid: "022925662268440c91fff7e8732d7a0b" member_type: VOTER last_known_addr { host: "127.3.200.67" port: 39437 } } peers { permanent_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" member_type: VOTER last_known_addr { host: "127.3.200.68" port: 38743 } }
I20260709 12:27:25.108330  7005 tablet_service.cc:1558] Processing DeleteTablet for tablet 4db7053663484d018b4dcf9bfd77b330 with delete_type TABLET_DATA_DELETED (Replaced by 02785cd113ee41d6935f5dddac6f6dbd at 2026-07-09 12:27:22 UTC) from {username='slave'} at 127.0.0.1:34196
I20260709 12:27:25.110111  7013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f0c1fabae4b45f5a06cac8289e281ab" candidate_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2c146bd91ab94c5191365c34a414a5e6" is_pre_election: true
I20260709 12:27:25.123600  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:25.124490  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:25.125422  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:25.126112  7158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6eb6cab9bda4770b44ece4d2a9351eb" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:25.132483  7008 raft_consensus.cc:1275] T 7a9b67ee02db405787e857725c431127 P 2c146bd91ab94c5191365c34a414a5e6 [term 5 FOLLOWER]: Refusing update from remote peer e6a8a26eb5294e4cb87412a7f2698f41: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:25.135346  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff8d600c9224a3089ef3ccecd0c25fd" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:25.151827  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbef1c76ff7d498c80d88abdea210535" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b" is_pre_election: true
I20260709 12:27:25.151964  7239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc2cfad86bb45cea81a8a9b6df167d8" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:25.153429  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2918b8da0cae441dae40ec77664c668c" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:25.159736  7233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5441bfff9f464980afe37a60473c5165" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
W20260709 12:27:25.163187  7205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.200.66:36713, user_credentials={real_user=slave}} blocked reactor thread for 51179.9us
I20260709 12:27:25.163607  7237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854ce637450c47bd8bc6a0a482a2f0c9" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:25.160386  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3af91840ca144a7b9595ccb5dfd4527" candidate_uuid: "022925662268440c91fff7e8732d7a0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:25.164209  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a3ee09e96b456ebb64bb214205c697" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:25.103312  8783 raft_consensus.cc:2804] T 409650d511434499a9f653d298a44c6b P 2c146bd91ab94c5191365c34a414a5e6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:25.161499  7129 leader_election.cc:304] T f99919774f3a4dda86c7c90ad327b9bd P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 022925662268440c91fff7e8732d7a0b; no voters: 9e6e5c8ad44447588681b10df7ad79ca, e6a8a26eb5294e4cb87412a7f2698f41
I20260709 12:27:25.166800  7239 raft_consensus.cc:2393] T bfc2cfad86bb45cea81a8a9b6df167d8 P e6a8a26eb5294e4cb87412a7f2698f41 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca in current term 7: Already voted for candidate e6a8a26eb5294e4cb87412a7f2698f41 in this term.
I20260709 12:27:25.161084  7233 raft_consensus.cc:2468] T 5441bfff9f464980afe37a60473c5165 P e6a8a26eb5294e4cb87412a7f2698f41 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
W20260709 12:27:25.168669  7131 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:25.168218  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc5926243c0439fb58fe23dcbd604a1" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:25.170460  7162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f8dcbe1b0441da8488ac2bd01c93fe" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "022925662268440c91fff7e8732d7a0b"
I20260709 12:27:25.173857  7238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eb704d53a3841a4aae036013059732f" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41" is_pre_election: true
I20260709 12:27:25.174542  7238 raft_consensus.cc:2368] T 5eb704d53a3841a4aae036013059732f P e6a8a26eb5294e4cb87412a7f2698f41 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e6e5c8ad44447588681b10df7ad79ca for earlier term 7. Current term is 8.
I20260709 12:27:25.172997  7232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f445b9b3112b4c7d9c76e2f7cff0e129" candidate_uuid: "9e6e5c8ad44447588681b10df7ad79ca" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e6a8a26eb5294e4cb87412a7f2698f41"
I20260709 12:27:25.178696  7158 raft_consensus.cc:2468] T d6eb6cab9bda4770b44ece4d2a9351eb P 022925662268440c91fff7e8732d7a0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e6e5c8ad44447588681b10df7ad79ca in term 4.
I20260709 12:27:25.186185  8840 leader_election.cc:290] T 2a631201d3d0438faa6efb30d0100608 P 022925662268440c91fff7e8732d7a0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e6e5c8ad44447588681b10df7ad79ca (127.3.200.66:36713), e6a8a26eb5294e4cb87412a7f2698f41 (127.3.200.68:38743)
    @     0x7f28719fdc87 __libc_start_main at ??:0
    @           0x29f0da _start at ??:?
